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In 1971 the Office of Child Development initiated tvhe 
National Home Start Demonstration P::ogram to demonstrate 
"alternative ways of providing Head Start*type comprehensive 
services for young children in their homes." The program, 
which becanie operational in the spring of 1972 and continued 
until June 1975, was designed to enhance mothers' skills in 
dealing with their own children in the home* At the same 
time, comprehensive social*emotional, health, and nutritional 
objectives were adopted as part of the core program. 

Concurrent with the initiation of the Home Start Demon" 
stration Program, the Office of Child Development funded a 
major evaluation. Its purpose was to collect information on 
both the Home start process and the program's effectiveness 
so that the Home start experience could lead to' ^reccaismenda* 
tions for future home-based programs* The evaluation d$^ 
scribed the program^ assessed its effects at various time 
points (relative to a randomly assigned control group) and 
compared the effects after one and two years of program 
participation. In addition^ it was designed to compare th^ 
effects and costs of Home start and Head Start programs. 

This final report of thW evaluation of the National Home 
Start Demonstration Program is addressed to a variety of 
audiences interested in home-based programs for young children 



• national policymakers who must identify the best 
possible mixture of programs for carrying out 
legislative intent in searving children of the poor; 

e national and regional program administrators who 
must decide where and how to install local projects 
and then provide adequate control and technical 
assistance in helping projects use their funds 
more effectively; 

e local program operators who are considering adding 
a home*based option to their already existing center 
program for young children; and, 

e the child development research community which is 
constantly seeking more effective ways to help chil- 
dren fully develop their potential and to determine 
program effectiveness and impact. 
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It is imposiSible to respond completely to the information 
needs of each group in a succinct summary such as this or to 
bring out every fact we h&ve learned about Home Start. This 
report can only highlight major findings obtained over the 
three and a half yearsr and briefly discuss their implications. 

Information essential for understanding the findings is 
presented in Chapter I which briefly describes the program 
and the design ard methodology of the evaluation. Additional 
details can be found in Appendix A {Program Overview) and 
Appendix B ^Evaluation Design and Methodology) and in the seven 
interl:!! reports that have been submitted in the course of the 
evaluation. Chapter II reviews major findings in three sections: 
program intact on parents and children r the relative costs and 
ef£ect££ of Home Start and Head Starts and programmatic findings. 
The concluding chapter presents implications of these findings 
for future home^based programs and for federal de^rionatration 
programs. For baclfground informatioa or further details a 
list ot ail previous Home Start evaluation reports ana a de^* 
tailed index to 32 topics in the?*^ reports are incrluded as 
Appendix C. 

It is impossible to coc*plete any evaluation as large as 
this without the help of numerous people. Several of these 
deserve special recognition for their contribution over the 
three and one-half years of the evaluation. 

Tv;o people^ especiallyr were responsible for the unusual 
potential that the evaluation dosign offered to those worJ;ing 
on it. Thsae two people«-the National Evaluation Project 
Officer^ Dr. Esther Kreshr and the National Home Start 
Diirectorr Dr. (Ruth) Ann G*Keefe'^'*are in the Offlfre of Child 
Development^ Office of Human Development, tl«S. Department of 
Healthr Educationr and Welfare. Their clO£?e cooperationr be*- 
ginning with the Initial conceptualization of the National 
iioKe Start Demonstration Program in late 1971 r led to a close* 
knit integration of evaluation and program activities and 
minimized most of the major problems typically faced by other 
evaluators on similar projects. 

Throughout the three and onc^half year evaluation r the 16 
local Home Start project directors and their staffs played a 
vital role by generously responding to the seemingly endle.s 
evaluation demands. The six directors and their staffs in- 
volved in the summative evaluation deseanre special recognition. 
The Head Start directors and their staffSr likewiser played a 
vital role in securing essential family and program comparison 
data. 

Special thanks are due to the Home Start and Head Start 
parents and children who voluntarily participated in many 
hours of interviewing and testing over the last three years ^ 
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knowing the results would never help thon directly but might 
benefit others. Recognition also goes to the community inter* 
viewers in each summative site who approached ■ their difficult 
and often discouraging data collection tasks with a level o£ 
personal dedication that overcame many seemingly insurmountable 
problems. 

Numerous consultants volunteered their asristance on prob- 
lems met at different stages of the evaluation; among them the 
National Review panel convened by the Office of Child Develop- 
ment who made valuable contributions to the initial design and 
early evaluation reports, and the National Advisory Panel who 
assisted with many specific problems and provided ideas and 
encouragement for enlarging the scope of our investigations. 

We also want to acknowledge the work of High/Scope Founda- 
tion and Abt Associates* staff who played major roles in the 
evaluation: Dennis Deloria guided the project from its incep" 
tion -through three years of evaluation activities. Dennis 
set the tone for rigorous adherence to the standards o£ scien* 
tific evaluation tempered with the conviction that the dedica- 
tion of everyone associated with the program deseanred an equal 
coimnitment by the evaludtors to be sensitive to the very per*- 
sonal nature of Home Start and its participants; Marrit Nauta 
anchoi^ed the management oT all field operations*-testing of 
children, fainily obseinrations and program data collection. 
She made major contributions to the conc**ptualization and 
writing of all reports. In short, she often was the glue that 
kept the project together and moving; Craig Coelen conducted 
all cost and cos t*ef feet iveness analyses and made numerous 
recommendations for imp;:oving program efficiency by linking 
outcome, cost and programmatic/process data; Ilobert Hanveyr 
Nancy Naylor and their staff carried out all data processing 
over the three and one^half years and made major contributions 
to the data analysis; Kathy Hewett and Chris Jerome formed a 
unique team in translating interview and analysis data into 
several series of case studies which highlighted exci.ting 
elements of the 16 Home Start projects and jointly coordinated 
development of the Homesbook to provide one of the most compre- 
hensive insights into home-based programs and their operations; 
and Ilona Ferraro was responsible for numerous administrative 
tasks, including production of all reports^ planning of field 
visits and summative data collection, and the Home Start 
Information System. 

For each person or groups of people mentioned above/ there 
were many more who carried out less conspicuous bat no less 
important roles. Each contributed in his or her own unique 
way to the completion of the work presented here. The names 
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of all contributors not mentioned here are listed in Appen* 
dix 0 of this report. He are indebted to all for their 
encouragements and contributions of time and ideas. We hope 
that the information obtained from this evaluation will in 
some way be useful to those who strive tx> improve the quality 
of life for children and their families. 



John M**Eove 
Project Director 
High/Scope Educational Research 
Foundation 



Richard R. Ruopp 

Director of Formative Evaluation 
Abt Associates Inc. 
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PROGRAM AND EVALUATION OVERVIEW 



A brief overview of the National Home Start Demonstration 
Program and the Home Start evaluation is presented here to 
provide a context for findings and their implications included 
in subsequent chapters of this report, A more detailed dis- 
cussion about the Home Start Program and the evaluation ca. be 
found in Appendices A and B. 

Program Overview 

Home Start was a program for low income preschool children 
and their families, funded for a three^year demonstration 
period by the Office of Child Development, Office of Human 
Development, U.S. Department of Health, Education, and Welfare, 
The program started in March 1972 and concluded in June 1975. 
Sixteen Home Start projects were funded as part of the threes 
year demonstration, with each project receiving approximately 
$100,000 per year with which to seirve 80 families. 



Pr ogram Focus 

Recognizing the importance of the early years in the child' 
development and the family *s role in providing an environment 
for young children conducive to child growth and development. 
Home Start's intent was to build upon existing family strengths 
Through a conscious effort to focus program efforts primarily 
on parents (rather than on children as is done in center-based 
programs), parents played a unique role in Home Start: they 
were viewed as. the ^ first and most important educators of their 
own children." While Home Start was certainly designed to ben 
efit preschool children, it was through the parents that Home 
Start hoped to have its impact. 

In many respects. Home Start was a prograun not only con- 
cerned with the preschool child but with the well-being of the 
total family . In addition to educational concerns (getting 
the chila ready for scjiool and giving her. or him a ^'head start" 
in life while still at home) , the proaram stressed the iropor*- 
tance of good health oare and nutrition and acquainted families 
with a variety of community resources they coidd utilize to 
help meet family needs. This ^total family^ focus was crucial 
to program success, with program sexvlces expected to benefit 
not only parents and preschool children, but older and younger 
siblings and those not yet bom aS well. 



^Home Start Guidelines, page 1. 
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Program Activities 



Program staff (primarily hcmte visitors) translated progr€U3(t 
goals into action through regular home visits , group activities 
for parents and children, and arrangements with community 
agencies to help meet a variety of needs. The principal mech-* 
anism for providing services to families was the home visit* 
Typically, these took place an average of twice a month and 
lasted roughly an hour and a half with each family* The visit 
focused about equally on parent and child activities, which were 
most often introduced or initiated by the home visitor* Although 
the focus of the home visit was primarily the parent, since the 
parent was almost always present and actively involved when ■ 
child activities were being conducted, in teinas of interactions 
among participants, the time was about equally divided: one 
third of the interactions were between home visitor and parent, 
one third between^iome visitor and child, and one third were 
interactions involving all three participants* 

Most home visitors followed a curriculum for the home visit 
to insure that all four components (education, healthy nutrir^ 
tion and social/psychological services) were covered during 
the visit* As is shown in Figure 1, over half of the visit 
time was devoted to educational concejms (school readiness and 
physical development of the child, and educating the parent 
about child development and education) * Ho two home visits 
were the same; they were specifically geared to the needs of 
the individual parent and child being visited* H^e visitors 

■ 

Figure 1 
Focus of Home Visit Activities 



On Family Health 
And nutrition 




These four components were adopted for Home Start evaluation 
purposes; official program components of Home Start, as well 
as Head Start, however, weret education, health (including 
nutrition, dental and mental health), social services and . 
parent involvement* 



frequently left materials in the home and encouraged the parent 
to continue to do similar activities with the child following 
the visit to maximize program benefits for the child. 

Home visits were supplemented by monthly group activities 
for parents and children in most of the projects. The chil- 
dren's groups were designed to give them an opportunity to 
develop socially and cognitively outside the home prior to 
entering school. This was especially important since many of 
the Home Start children lived in isolated communities and had 
little opportunity for socialization. Monthly parent group 
meetings provided not only japportunities to get together with 
other parentSr but also to learn about child developmentr nu- 
trition, adult basic education courses and other topics of 
interest* Through these meetings parents became involved in 
Home Start business r planning of program activities and policy 
making. 

The program consisted of four components which were de^ 
signed to meet the educational, nutritional, healtii and psycho- 
logical/social needs of families. Parent invjlveme^it was not 
included as a Home Start component since it formed the founda* 
tion of the entire program. These 'components are described in 
detail in Appendix A. 

2 

Program Participants etnd Staff 

On the averager Home Start projects each reached 126 
"different** families over the course of one year and had a 
quarterly enrollment of about 74 families. Eligibility 
guidelines were the same as for Head Start-*-families were 
considered eligible if their annual income was within fed- 
eral poverty guidelines and if they had at least one child 
between the ages of three and five. The average income of 
the Home Start family was less than $6r000 per year to sup-* 
port a family of four or five. Incomes were supplemented 
at least for some families by the use of a variety of commun- 
ity resources such as Welfare and APDC (45%) and food stamps 
(40%). In many families (41%) neither parent was employed. 
In generalr the parents represented a low socio^^economic 
status r as reflected in occupational level tmedian of 7 on 
the 96 level Duncan index) and educational level (mean of 9.7 
grades completed for the mother). About a quarter (28%) of 
the mothers had graduated from high school. 

Of the 242 children under age five that each Home Start 
project reached per year^ 160 were between the ages of three 
and five. Almost all (93%) of these children were considered 
focal and received full program benefits. Most had received 



^Ibid. ; 

^he piA>gram participant characteristics reported are a 
profile of families involved in the summative evaluation. 
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essential iinmunizations when they enrolled in Home Start 
(6dx>ut 85%), but had not seen a doctor for almost eight months* 
Some of them (13%) had been medically diagnosed as handicapped 
(most of these were physical handicaps) . This exceeded the 
Head Start requirement for a handicapped enrollment of 10%. 

The typical project had a staff of 12: seven home visitors, 
a director p three specialists (a nurse, social searvice/parent 
involvement coordinator and either a home visitor supearvisor 
or an education/child development specialist), and a secretary* 
The hOTie visitors, more than being key persons in the program, 
were the program so far as most families were concerned* On 
the average, they provided searvices to from 10 to 11 families 
each. The typical home visitor was a 34'*year old woman, with 
a family of her own. She completed high school, spent some 
time in college, and before joining Home Start was ^ployed in 
a job which in scnne way related to her work as a home visi1:or. 



Evaluation Ovearview 

A national evaluation was funded to run concurrently with 
the Home Start Demonstration Program (1972-^1975), The evalua- 
tion was designed to measure the effects of home*-based program 
operations by documenting actual changes in parents and chil- 
dren (summative evaluation) and to determine the relative cost 
effectiveness of Home Start and Head Start (cost*-ef f ectiveness 
evaluation), A third component of the evaluation (program and 
process evaluation) examined several key aspects of program 
operations to provide a relatively complete understanding of 
the program* The collection of programmatic and process data 
also permitted an examination of the relationship between par- 
ent and child outcomes, costs and key elements of the program, 
as well as providing a basis for making recommendations for 
operating home-based programs and for Improving program 
efficiency. 

Evaluation Design 

A critical feature of the design was the randomly assigned, 
delayed-entry '^control" group and the coit^arison group of Head 
Start families against which to judge Home Start's impact and 
effectiveness. Whereas all 16 Home Start projects participated 
in the program and process evaluation, only six were involved 
in the summative evaluation. Although the six were not randomly 
selected for a variety of practical considerations, there 
appeared to be no major differences between the summative sites 
and the other ten. 

To permit the selection of a control group, the summative 
projects recruited twice as many families as could be enrolled 
in the program. An att^pt was made to randomly assign families 
to Home Start and control groups; although, technically, full 
random assignment was not achieved, there were virtually no dif^ 
ferences between the two groups in their entering characteristics. 
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The faiaiiies in the control group participated in Home Start 
after they had been on the waiting list for one year. They 
thep became the one-year program group for comparisons of 
two- vs, one-year program effects. 

Families were not randomly assigned to Head Start, and 
indications are that Head Start and Home Start in the six 
suiamative sites served different populations. In general/ 
Head Start families were less disadvantaged than Home Start 
families. Head Start comparison groups were tested at four 
of the sxammative sites where there were two-year programs. 
During the final year of the evaluation, data were also ob- 
tained from Head Start programs in the two urban sites oper- 
ating one-year programs. 

It is important to point out that the Home Start-Head 
Start comparison is more complicated than the Home Starts- 
control comparison. In addition to serving different popu- 
lations, the program focus of each is quite different. Heme 
Start focused more on the development of parenting skills; 
in contrast, one of the important indirect -services provided 
by Head Start--day care for mothers who work — was a benefit 
Home Start was not expected to provide. 

Data Collection 

Summative data were collected each fall and spring 
starting in 1973 and ending in 19?5, following a pilot yee.r 
designed to give projects an opportunity to become fully 
operational and to test the measures selected for the summa* 
tive evaluation. Data were obtained at four time points to 
assess program impact; fall 1973 (pretest), spring 1974 
(7 raonths^later) * fall 1974 (12 months later) and spring 
1975 (20 months after the pretest) , The final phase of the 
evaluation (1974-75) included a comparison of program impact 
after one and two years of program involvement, as well as a 
replication study of the 7-month findings. 

Measures 

To provide a broad assessment of program effects on 
children and parents, 11 measures were selected for the sum- 
mative evaluation. Impact on children was measured in the 
areas of school readiness, social^emotional develo|xnent, 
physical development, nutrition, and medical care. The pro- 
gram goals for mothers-*- that were meas.xed included mother/ 
child relationship, mother as teacher, home materials for 
the child and use of community resources. Descriptions of 
the measures are included in Appendix B, 



Although both parents are equally emphasized in the Home 
Start Guidelines , about 95% of the parent data obtained" 
were from mothers, 
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FINDINGS 



The evaluation results discussed below are based on inter ^ 
views, standardized measurements/ and emalyses which policy 
makers need to make decisions about national child cajte resources^ 
Neither federal program staff nor evaluation staff, 'however, be* 
lieve that such evaluation results tell the entire story about a 
program which served diverse families in various locations^ 
Throughout the Jthree-year evaluation period, researchers talked., 
to dozens of parents, grandparents, agency staff and townspeople 
to fill in the lively details of the Home Start story* In fact, 
there is no typical Home Start story; there are many^ many differ* 
ent ones* To know a few details about some families in Home 
Start is to understand more fully the changes and experiences 
which the findings in this section can only suggest* 

Home Stmt's families were diverse in every respect**in 
their cultural backgrounds (white, black, Appalachian, Eskimo, 
Navajo, Migrant, Spanish*speaking and Oriental), their economic 
circumstances, their sizes, their attitudes toward life, their 
physical surroundings, and theijr needs* According to program 
eligibility guidelines, all faotoilies shared a common circumstance: 
not enough money to buy fo6d, clothes, shelter, and services they 
needed* Some families lacked experience to successfully manage 
the limited funds available to them* Although poor could mean 
one set of experiences in the Appalachian hills of West Virginia 
and another in the streets of Cleveland, no family wanted to be 
poor* Program staff soon learned, as one Home Visitor said, 
"you can't lump them all together, poor people*-^hey*re individ- 
uals like everyone else*" 

Equally diverse and individual are the "results^ which 
parents and staff attribute to their Home Start experience* 

• When their breadwinner father became partly paralysed 
after a work accident, a family in Otah had .Home .Stut 
help in obtaining financial support and in developing 
new family routines which included the father in caring 
for two preschool*age daughters* In addition, the 
mother found part-^time work and made friends, both 
personal and professional, who helped her to cope 
with the Ci.^'iaes in her life* 

• Another mother, a young Cleveland widow with six boys, 
relied on Home Start primarily for encouragement in 
expanding the activities she was already doing with 
and for b^r children* She began with the program's 
Parent Advisory Council; later beca.ae elected committee- 
woman in her ward, and returned to school for her 
General Equivalency Diploma (GED) * 
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In Gloucester/ Home Start staff helped arrange for a 
series of screenings for the youngest boy of a large 
family whose parents believed he might have learning 
problems* ^en no physical difficulties' were identic* 
fied^ the Home Visitor helped parentB^to chi&nge their 
expectations for the boy and be less protective of 
him* , Soon he talked more readily # was more independ^ 
ent/ played alone, and had little difficulty with the 
games of colors and numbers his older sisters liked 
to play witii him* 

e A young Binghamton mother <with three small children 
found that Home Start helped break her sel£*imposed 
isolation* •Before,'^ she said, **J wouldn^t go out 
of my house* But Borne Start, when I finally tried 
it, got me out of my shell, got me' talking, with other 
mothers* HOTie Start is a two-way thing j it* a very 
good for the^hildren and it* s good for me, to find 
that my own probl:^s aren*t that earth*8haking***^ 

One staff manber in the Arizona program reported that many 
Navajo parents showed increasing interest in all their children's 
education ^fter being in Home Start* Joint efftrrte of staff and 
parents Tn the Weslaco, Texas program helped to begin the long 
process of improving health and community services to migrant 
families in the area* In West Virginia, groups of parents formed 
to help each other repair h<siies, provide electricity and plumbing 
and impirove local roads* ~ 

In short, many changes in Home Start families as a result of 
their progreun experience a3^d unrecorded here; they persist in the 
ways that parents approach continuing and inevitable problems 
with housing, jobs, or family members; in their willingness to 
tackle new jobs and learn new_skills; in knowing where to go and 
how to ask for help on their own terms when they need it* And 
for many parents, the influence of Home Start shows up simply in 
the quality of the relationship-between them and their children*-* 
a relationship more clearly understood by some, more eagerly « 
developed by others, and more rewarding, they say* 

'Alaskans Project Director approached H<Mne Stetrt with scnoe 
real questions; but at. the end of three years, she said **I have 
seen that progress is possible and that it is possible in a rel<^ 
atively short time* Parents really can help themselves if some* 
one can come up with a basic pattern about how to develop a plem 
for it* If it works here in the midst of all the other givens _ 
we have in Alaska*"the isolation, the cold weather, the high 
prices, the alcoholism, the you-name-it-*if it works here, it 
should really work in other places*** 
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There are a number of research findings from the three and ^ \ 

one-half years of the evaluation which support the descriptive * 
program successes presented above* These findings, based o;n,a > ^ 
systematic assessment of the program and its impact on partif;^i£^ ^ 
pants, provide clear evidence that Home Start was effective f^J^j^:^^! 
both parents and children* The research findings address a 
number of key questions about the program, its operations and '--^ 
its costs, as well as examine the relationship between program T"^^^ 
characteristics and processes and program impact* ^Nt.^ 

The research findings are presented in three^^^^pns t "'^iK^^^ 
The first reports the impact that Home Start Jiad^b^^raSilies. ^ . 
and their preschool children as measured b^^the summative * ^ 
evaluation* Results from the different phases of the evalua- 
tion are integrated in this discussion, organized aurouhd key ^ - 
questions* For example, data from the 7-, 12- and 20-mbnth 
outcome analyses are presented together in order to co^letely . . 
describe prograua impact on children and parents* Also addressed 
is the issue of whether two years of Home Start were more effec* 
tive than one year* The second section summarises cost*-ef f ec* 
tiveness findings, comparing Home Start with Head Start and 
examining length of program participation* ^ ^ 

The third section presents findings regarding^ the imple^ 
mentation of the Home Start program (program characteristics,,^ 
processes, staffing and costs) and examines relati^'ships be^ 
tween program and baff characteristics and seme variables " ^ 

that are indicative of the implementation process* Also 
addressed are relationships bet^en implementation variables 
2tnd child or parent outcomes reported in the beginning of the 
chapter* The key variables included in these discussions are 
the home visit, the hcane visitor, program structure, js^rvgram 
seirvices, family participation, and program costs* 



Impact on Families and Children 

The impact of Home Start on families and children examined 
at each time point from spring 1974 to spring 1975 is summar* 
ised here according to key questions* Analyses related to addi* 
tional questions of a less general interest have been reported 
in earlier interim reports* Earlier reports also contain de^ 
tails on the specific measures and the particular analyses that 
were conducted to produce the findings* 
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1. Was Borne start effective for parents? 

YBSf on a number of dimensions at both 7 and 12 monthSf Bome 
Start produced significant changes in parents compared to the 
control group. 



These findings are particularly important because of the 
pQl;^tial that changes in parents have for enhemclng the growth 
Qf^^;J;hildj:en in tJie family. The 7-flionth^ findings indicated 
^m^^jfl6«ne Start mothers when ccHftpared with controls were more 
IblkJty to allow their children jto help with household tasks r 
reported teaching mere reading and writing skills :to their 
children r provided more books and .comemon playthings for their 
children to use, and read stories to their children more often. 
Home Start mothers were more likely to employ a teaching st:yle 
involving thought-provoking questions/ as assessed in the 8- 
Block Task situation r to engage in a higher rate of verbal . 
interactions in that situation r and to focus their talk arouxid 
the dimensions of the task. 

The 7-month findings also showed that HcMe Start parents 
reported more involvement in community organizations such as 
parent-teacher groups^ boy scoutSr church organizations/ etc,/ 
than control parents. When asked about their use of Commun- 
ity resources such as the housing authority r job training pro** 
gramS/ etc, / however^ Home Start mothers reported greater usage 
of only one out of fifteen* 

After 12 months of involvement in the program some of the 
differences between Home Start and control families diminished. 
In most cases where the findings changed/ it was due to ir^proved 
performance on the part of the control group since they had 
entered the Home Start program by the time fall 1974 testing and 
interviewing began. 



2. Was Home Start effective for children? 

YBSt when tested after 7 monzba and again after 12 months of 
program involvement ^ Home Start children were found to differ 
significantly from the control children in several aspects of 
their growth and development. 



In school readJL/iesS/ after 7 months the Home Start children 
were significantly above the controls as measured by the Pre- 
school Inventory/ the DDST language scale and the child talk 
score from the 8*Block Task, At 12 months the PSI was the only 
single school readiness measure to differentiate the groups r but 
when all four outcomes were analyzed simultaneously using multi- 
variate analysis a significant difference was found favoring the 
Home Start children, - ' 
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In social -emotional development ^ only one of the measures 
(Task Orientation) showed a significant Home Start*^control 
difference at 7 months (favoring Home Start children) , bat 
after 12 months Home Start children were rated by their mothers 
as having greater tolerance as well as higher, levels of task 
orientation/ and the testers rated Home Start children as 
superior to the controls in task orientation* 

Home start children were reported by mothers as receiving 
better medical and dental care than controls after both 7 and 
12 months (Home Start children had seen a doctor and dentist 
more recently and the doctor's visit was more likely to have 
been for preventive reasons; but there was no difference at 
either time point in the number of basic, immunizations children 
in the two groups had received) * There were no strong differ- 
ences in children's fine and gross motor development at either 
time point* 

In the area of child nutrition^ according to mothers* 
report of food intake ^ the two groups did not differ in the 
overa* t quality of their diets* Nevertheless / at both time 
points the quality of children's diets was low in relation to 
levels commonly recoiamended by nutritionists* 



3* Were thro years of Home start more effective than one year? 

NO; there were very^few differences in outcomes for children 
and mothers who participated for two years and those who 
participated for one year* 



In the second year home visitors rated their two-year 
families as having greater potential for social and educa** 
tional development than their one-year families, but this 
effect was not strong* Of the 53 other variables examined 
to answer this question^ differences between the two-year 
and one-year groups were found on only five* 

Given these few differences^ the question arose as to 
whether there might be a difference for families whose chil* 
dren entered at one age but n.>t another* Two sets of analyses 
were performed to investigate the two-year vs* one'-year 
effects — one for families with children entering at age three 
and one for those with f our'-year-olds * Again r very few 
differences were found, supporting the conclusion that one 
program year is just as effective as two for both parents and 
children, regardless of whether families entered when children 
were tLree or four years of age. These findings are consistent 
with research on center*based programs which generally supports 
the conclusion that program duration within the preschool years 
is not a potent variable* Program duration and age of entry 
may have greater effects in programs for infants* 
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4. ftas "Borne 5tart as effective for parents as Head Sturt? 

YESf when the two groups were compared after 12 f and 20 
months ^f program involves^ntf there ware some differences 
favoring Head Start and seme favoring Some Start; for most 
variables, hotfever, there were no differences in the effects 
of the two programs. 



Comparisons of Home Start and, Head Start have been made 
cautiously xn this evaluation since the two groups wer^ fouxid 
to be serving different populations initially ju and because it 
is not known how representative these few Head Start programs 
are of all Head Starts programs in the country. It should also 
be kept in mind that the two are very different kinds of pro* 
grams and the seinrices and benefits provided by ^the two programs ^ 
do not completely overlap. 

Differences that were fouxid were prinnarily on home environ** 
ment variables and in the use of community resources. At both 
7 and 12 months « Home Start motherisi reported teacliing more 
elementary reading and writing skills to tt»ir children. At 20 
months* Home Start mothera reported they more frequently let 
their children "help** with simple household tasks. When parents 
were asked to indicate the extent to which th^ had used various 
community resources, there were few group differences. 

Althoi^h the minor differences that were fouxid suggest that 
Home Start's advantage is in producing a more positive effect on 
the mother*child relationship « there were actually very few Home 
Start*Hea<a Start differences. Cxven the large number of variables 
examined within the summative evaluation* it must be concluded 
that the two programs had very similar effects on parents. 



5. 


Was Home Start 


as effective for children as 


Head Start? 




YES/ 


although some 


significant differences were 


found at 7/ 


12 


and 


20 monthSf for 


most variables there were no 


differences 


in 


the 


effects of the 


two programs . 







In the area of school readiness, Home Start children sur- 
passed Head Start children on the Preschool Inventory at 7 months 
but not at the other time points. In social'-emotional develop*- 
ment/ Head Start children surpassed Home Start children in test 
orientation and sociability (POCL) at the 12«-month posttest only. 
At 12 months Head Start also showed greater gains on the DOST 
fine motor scale and at 20 months Head Start children had gained 
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more in height than Home Start children^ At both 7 and 12 
months the Head Stsirt group shoved higher quality of reported 
nutritional intake, but this difference disappeared by 20 
months; at two time points (12 and 20 months) Home Start 
children were reported by mothers to have gained more in their 
intake of vitamin supplements* 

As was true of the parent findings, the few differences - 
between the effects of Rc»ne Start and Read Start programs on 
children lead to the t conclusion that the two programs are 
virtually equally effective* 

Cost^Ef fectiveness Findings 

The findings relative to cost*^effectiveness can be summar- 
ized around two basic issueS'^^the cost^effectiveness of Home 
Start relative to Hfead Start and the cost '"effectiveness of in- 
creasing the length of the Home Start program* 



I. Was Borne Start as'^cost-eff active as Head Start? 

YBSi since the costs per child of Home Start were egual to or 
slightly less than the costs of Head Start/ and since the 
programs had essentially comparable effects^ Some Start was 
a cost-effective use of public funds relative to Bead Start. 



A useful assessment of the overall cost-effectiveness of 
Home Start was made by comparing its costs and effects, with the 
costs and effects of the Head St^u^t program* Head' Start is a 
good model for comparison for two reasons* First, it is a well- 
established program/ with considerable support at the community 
level/ among child advocates and in Congress* Second/ while the 
objectives of the two programs are not identical/ there are 
enough similarities that their effectiveness can be compared 
along a number of dimensions* 

Based, on data from 16 sites/ the cost of Home Start to the 
federal government per family per year was $1400* Based on 
data for projects in the. six summative sites, the federal govern* 
ment*3 cost for Head Start was $1730 per child per year* Home 
Start appears to be the less expensive of the two programs* 
These two estimates of unit costs suggest that 24% more children 
can be seirved via Heme Start than through Head Start for a given 
level of federal spending. Based on data tor only the four 
sites for which test data are available for comparisons of pro-- 
gram effoctivaiess/ the cost differential is evfm larger*-^ 31% 
more children seanred by Home Start than through Head Start— 
but this probably overstates the relative, costs ol the two 
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prograiAS on a n^tion^l biisis. Nevertheless/ it does| reflect 
the reliative quantities of resources (labor and materials) — 
which w«re used in generating the family perfonoances measured 
by the tests and questionnaires* Although no measurements 
have been made of _ long-rang? maintenance^ of Home Start effect8^ 
it would appear that at least in the short run the Home Start 
program is a cost-effective use of public fuiids* 



2* Did InGreas-lng program length Increase the GOst^^^ffeGtlve^ 
ness of Borne Start? 

NO; there was iittie evidence that the greater costs of longer 
famlltf. enrollment resulted In greater benefits to children or 
parents. 



A major difference between 7^ and 12'^<month programs was in 
the summer operations* Although no test data are ;ayailable with ' 
which to make a direct compariBon ..of 7*^nth an4 12^^nth pro* 
grams, some indirect comparisons are possihle^^l^irsl:^^^ on 
the searvice records of local -projects indicabetSiat :qiet^^ 
of a consistent home visit schedule ls'fe8pecia]l,l^s^difficult 
during summer months* Second* , those families ^dio received reg*- 
ular home visits during the summer months i!K:ored ho higher on 
summative measures than those fai&ilies.^vho received very few 
visits* Tt is possible that there would be sonte lohg-range 
effects of longer program duration that;, are not -apt^arent in 
immediate 12-month outccsnes/ but on the basis/ 6f this eyalua^ 
tion there is no strong evidence that s:ummer progrwicare worth^ 
the additional cost* Operating programs only dutin^!" the Septem- ; 
ber*June period has implications for staff who would be unai^loyed 
during the .summer months* 

Federal cost per family for the T^month period/ 
October 1973 to May 1974/ averaged approximately $900 across 
the 16 local projects* Federal cost f^r 12 months .averaged 
$1400 per family* From these two figuireS/ one would project 
the cost of 20 months of operation at ^2300* A decision to 
adopt a full'^year program, would reduce rth^ number of families 
by one*third from the number that could be served in a 7*month_ 
period for a given level of funding; a^2Q^month program' would 
require a 60% cutback in families* On » the basis p.f <»ffects 
measured immediately upon completioji of the program'/ a 20* 
month program is not cost^-effective comp^ed l:a a:;7^month 
program* The Home Start evaluation was not designed to 
determine whether there might be long^rang^B benefits extending- 
beyond the one or two years of participation in the program 
that would justify increasing the length of family participation* 



20 



18 



Progyammatic Findings 



Two sets of findings are presented in this section. The 
first and largest set are implementation findings £rom the 16 
Home Start projects. These are important for two reasonst 
they constitute data regarding what actually happens when a 
demonstration project is implemented^ and they provide a con-*^ 
text for understanding the summative and cost*-ef£ectiveness 
findings. The second set o£ findings consists of relation*^ 
ships that were found between implementation variables and 
program and sta£f characteristics ^ and findings relating im- 
plementation variables to parent and child outcomes. 

Program Implementation Findings 



i. Services received varlBd conftlderablg from family to family,. 



Although the same types of seinrices were available to all 
Home Start families^-home visits r group meetings £or children 
and parents^ and referrals to community agencies-^ help meet 
family needs— the intensity of services familfes received varied 
across as well as within projects. Some families received weekly 
home visits^ while others participated only in one per month. 
Variations in home visit frequency resulted primarily from emer- 
gencies or illnesses in the family or of the home visitor. Em^ 
phasis and duration of the visits differed as well with some 
'home visitors spending considerably more time on child activities. 
Variations were also found 'in the extent to iMiich families par- 
ticipated in group activities. 



^* Across'^site variations were found in family enrollment 
and per family costs » 



On the average^ Home Start projects served 74 families dur-^ 
ing a quarterly period**8% short of CCD's goal to reach 80 fami* 
lies. This ranged from a low of 63 Jto a high of 86.^ The cost 
of searving a family for one year averaged $1^750 ($1400' in fed- 
eral funds and $350 in locally contributed, goo^ls and seiniTces) 
but ranged from a low of $1^325 to a high of $2^505. 



Excluded from these ranges are three projects which obtained 
special permission from OCD to seinre fewer f amilie# per guatter 
because of the high cost of living in the areas served. Also 
excluded is the quarterly enrollment of one project which served 
considerably more families with a supplementary federal grant. 
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3. The number of specialists employed in vArious service 
deliver^ areas varied considerahljj across projects and 
affected program co3t. 



Certain local projects ^nployed staff specialists whose 
training and responsibilities were heavily concentrated in a 
single seinrice airea. One project eiq;>loyed a speech therapist.^ 
an educational therapist and. two educational aides but no 
nutritionist or social service coordinator* ^ Another project 
had on the staff two social service coordinators and a nurse 
but no educational specialist. Several projects/eo^lpyed no 
staff specialists at all. Although the evaluation. was not 
designed to determine the impact of trpecialists dn^ ]paren1^ t 
and children r an overemphesis on any particular seWice. delivery, 
area would likely not be as effective in providing , a wide yariety 
of services to families. 

Home Start was a highly labor intensive program (with 75* 
of the budget being spent on personnel). The. addition of spec*^ 
ialists increased per family cost. Hiring a^ home visitor super* 
visorr a coordinator/supervisor and a nurse/nubritidnist and 
paying consiatants would increase project costs by an additional 
25-32%, 



4, Projects wer« successful in ohtainin^ a considerahle 
amount of resources from community sources* 



Roughly 20% of the total resources used by Hdme Start were 
obtained from local community sources, This represented about 
$350 in, services and goods per family (including medical and 
dental examsr clothing^ foodr adult education classes and simi* 
lar seinrices). Thirteen of the sixteen proi^ects matched more 
than 20 cents for every federal dollar with locally obtained 
goods and seinrices. In a fw projects^ the matching rate was 
as high as 40 cents per federal dollar. 



5. Borne visitors were paid low salari&s for the professional 
work they did* 



Home visitors on the average were paid slightly over $5^000 
per yearr often for working 50 to 60 hours per week^ a salary 
which provided less than 70% of a low income standard of living 

for a family of four, ^ This percentage varied substantially 

' ■ *■ 



^he low incc^e standard of living for a family of four was de** 
termined using U, S, Department of Labor statistics C Mbnthly Labor 
Review r August 1974) for metropolitan areas nearest to the Home 
Start projects. 



across projects^ from a low of 52% of a lovHlncome budget to 
a high of 85%, and cannot be explained in terms of regional 
variation in the cost^^f^ living index. 



6* Hom& visit focus on parents increased over the course 
of the demonstration program* 



The emphasis placed on the pafent' in home visits increased 
considerably over two years as determined by observations of 
home visits. The shift in emphasis frossk child to parent can 
be attributed to an increasing awaferifess~ bn 1;he part of home 
visitors and other project staff of the appropriate ' role of 
the parent in the ^lome visit, as well as to training dnd tech- 
nical assistance provided by National Home Start office staff. 



7. Home Start was partially successful In Involving other 
family members in program activities* 



Although projects did their best to involve fathers in 
the program, both parents were considered **focal** in only a 
few Home Start families (16%). Participation of fathers in 
home visits was minimal (10% of the observed visits) primarily 
because visits usually took place during the day when fathers 
were at work. The curriculum used for home visits frequently 
encouraged father involvement in activities to be conducted in- 
between visits. Several projects arranged special activities 
of interest to fathers such as workshops^ covered dish, suppers 
and other social events. Fathers made up 16% of Farent^olicy 
Council membership. The extent of father involven^nt in the 
program was affected by the considerable number of single- 
parent families (24%) that participated in the program. 

On the other hand, sibling participation was considerable 
in Home Start* In 85% of the families with siblings/ they were 
almost always involved in hcrnie visit activities. They also 
, participated in child group meetings^ and in other Home Start 
events, such as field trips, picnics, etc. Several projects 
made special arrangements to involve older siblings in -Home 
Start or outside youth program activities. 
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Supervision provided to bontB visitors uas not completely 
adequate. 



While projects on the average devoted 6,5 hours per month 
per home visitor to in*hoioe supervision, 12 of the 16 projects 
provided less of this direct supeinrision « An additional 4*5 
hours were spent in office su|>ervision, reviewing home visiting 
and referral records and consultations with individual home 
visitors* Projects providing minimal supeinrision in the field 
(printarily because they lacked the staff for such monitoring) 
spent considerably more time on office supervision* Although 
there are no established standards for the extent to which 
supervision should be provided, in*home supervision^ appears 
essential for the home-based program in view of the complexity 
of the home visitors' jobs and their educational backgrbm^s* 



9* A Considerable number of referrals were a«de to help 
meet family needs* 

Home Start projects utilized a wide variety of resources 
and seinrices in the community on an as^needed basis to provide 
education, health, nutrition, social and psychological seinrices 
for families. Referral activity was considerable, with an 
average of seven referrals made per family during a one^year 
period, or a total of 15,600 referrals for the entire program. 
Few federal OCD dollars were expended to pay for services to 
help meet family needs (less than 3% of total^ federal expendi- 
tures^)* Variations in the number of referrals made across 
projects were considerable, suggesting that referral activity 
was dependent primarily on the number and types of services 
that were available in the community. There is no indication 
that the presence of specialists resulted in increased referral 
activity for families. In many projects with social service 
coordinators, for example, the number of referrals was actually 
lower than in projects without such specialist staff* This was 
most likely the result of a lack of resources in the community 
or more careful identification of family needs before a referral 
was made for services. 



This included paid consultants to provide training services 
for staff, to conduct workshops for parents, and to develop 
curriculum for home visits. 
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Relationships among Implementation, 
Characteristics^ and Outcomes^ 



Program and Staff 



Home visitors working with more than 25 families bad 
difficulty maintaining frequent and regular contact 
with families. 



Home visitors worked with an average of 10 to 11 families , 
but the number of families assigned per home visitor ranged 
from a low of six to a high of 20* Home visitors working with 
more than 13 families made home visits less frequently, result* 
ing in a decline in child development in the areas of school 
readiness and language development*^ In contrast/ there is 
no evidence to suggest that hcMne visitors serving fewer than 
nine families had greater impact on parents* 



2* Home visitors with children made fewer home visits than 
those with no children at ijome* 



Home visitors with children of their own made fewer visits 
to families than those with no children* Most likely, home 
visitors with children were away from their jobs more frequently 
'because of emergencies or illnesses of children at home or be-* 
cause they worked less* 



Home visitor age and the length of time she had been 
employed by the project affected home visit focus and 

COJ3 teJ3 t ' 



Two home visitor characteristics were found to affect the 
^content and focus of home visits* Older home visitors spent 
less time c^^^lW^SpHJie parent about the child than younger 
home visitors did (about a third less time with each ten*year 
interval) * Older home visitors tended to adopt a grandmotherly* 
attitude and focused most of their attention on the child* The 
longer the home visitor had worked with the jprogram the more 
time she devoted to educating the parent about the child, w^ich 
implies she was getting more coinfort£dDle with the stated goal 
of emphasizing the parent as the most influential educator of 
her own children. There is, however, no evidence that home 
visitors who spent more time with the parent had a greater im*^ 
pact on either parents or children; it is possible, of course, 
that the relative emphasis on parentp. could relate to long-term 
effects for both parent and child. 




As measured by the Preschool Inventory and the Denver Developmental 
Screening Test * 
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4. Specialists did not bAve an impact on the length of time 
spent on specific content areas during home visits* 



There is no evidence to suggest that the presence of a - 
particular specialist had an iinpact on the amount of time hcnoe 
visitors spent on specific c<»nponent activities* For ex^al^le^ 
home visitors in projects with or without a health specialist 
spent the same amount of time on health education in home , ^ 
visits* Although the stu^ was not designed to determiiie; the. 
impact of specialists on parents and children^ it is cle^r'^ Vr^^^^ 
that they made a qualitative difference in project opsrmp±oiail 
by supporting and helping, home visitoirtf lind t>y prpyidiitg ^sopiie 
direct services to families* 



5. The ajsount of borne visSt time spent on a particular^;, 
component was not associated ultb positive parent and 
child outcomes. 



There was no statistically significant Relationship between 
the amount of visit time devoted to a specific program objective 
and parent and child outcomes in that area* It was founds for 
example^ that the heavy ^aphasis placed on school readiness 
(27% of total visit time) ' in.h^me visits was not warranted* 
Home visitors spending consistently more time in the area of ' 
school readiness did not achieve different results with children 
than h<^e visitors vho devoted less time to this program objec*^ 
tive. 



6. Home visit frequency was affected by program location 
and focal child age. 



Families located in urban areas received fewer home visits 
than those residing In rural location:^ This ds^probably be*'* - 
cause it is more difficult to set up a regular hc»ne visiting 
schedule with urban families* Home vi%it frequency also re* 
lated to the age of the focal child^-families with older focal 
children received fewer visits but the visits were considerably 
longer irf duration than those made to families with a youxiger 
focal child* Variations in frequency and duration of home visits 
are probably related to children's capacity to participate in 
home visiting activities for given lengths of time* 
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7^ Variations in the frequency and duration of fiojDd visits 
had an effect on parent and cAild outcomes* 



Tb^re was a statistically significant, relationsliip betyeen 
frequency and duration of hone visiting activity wi1^,,,£a]|illiea- 
and parent and child outconies* The. language abiliti:e^\p£ fobal 
children developed inpre slowly in instances ^«tfhere^hbme^. vis£^i:s 
vnade fewer than^ three visits per lobnth* Sigiiiificant: ^^ciinp^ 
in child development^ were associated ^with contact t5^e b^^ 
the i^amlly and the hooe visitor falling below albout «i^bur ^i^^ 
a half to two hours per home visit* • - ^ 





As measured by the Preschool Inventory and the Denver 
OevelO£»Dental Screening Test« 
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IMPLICATIONS AMD COMCLOSIOMS 



The results of the evaluation of the^ National Home Start 
Demonstration Program show that a hame*-based^ j^rogram can be 
successful along a ntimber of child and parent d^ensionS/ and 
that it is cost*ef£ective relative to Head Start programs in 
the^same communities* The evaluation findings exten^ beyond 
these basic conclusions that >ierfi^9unmari2^d in. Chaj^^tejc^ XI , 
how^erV in that they contain a number of .ikpllcationi^^^ 
for the operation of futuxe home-based programs and for the 
conduct of federal danonstration progfacroa.v^: tfhe pii:^^ 
this chapter is to present the major implicat^ioh that/ appear 
to -.follow from the. wealth of infoinnatibn collected as part of 
this evaluation* This report concludes with a discussion of 
the general izability of these findings and Implicati^msi 

Implications for Home-*Based Pyograms. _ 



i.. ParaprofessionaJs can be effective providers at 
Home Start services 

Many of the -Home Start acmev^oents can l^e ditectly 
attributed to the. home visitors, 90% of whom had .lfttl* or 
no formal training and did-not generally have much ex^ieirience 
in working with families or in providing the :varied"-chi^d 
development, nutrition and health services/ They;:rp}:ay^ 
key role in the delivery of these services ,aiid dl^vthe work 
of professionals. Xn fact, not being^'*professional^ -w^s 
viewed by many project staff as an asset, making^ it iaaisier to 
establish a close and trusting relationship with par^^ts^. 

Besides these positive features of using paraprbfessionals, 
there are cost advantages. Employing home visitors \^i:^ college 
degrees would have increased the cost of the Home S^rl:; program 
by 15*20%* Further, analyses of summative data iiidicalied that 
home vif;itors with degtees had thjS ^ame;impact oh pai^tints and 
children as visitors wlio had only the pre* and inserVibe 
training provided by thjs program* --^ /; 

Given the importance of paraprofessionals , .it Height be 
appropriate for OCD to review" Child Development Associate (CDA) 
policies and consider including home* visiting v>xperience as 
part of the basis for certification* - . \ 
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2. Three features of program operations — training, supervision f 
and the use of specialistS'^^'dGSGrve special attention* 



Home Start projects devoted an average of five and one-half 
days per month to inservice training to help home visitors in 
their demanding and multi-faceted jobs* Staff gained skills in 
teaching parents to educate their children as a result of this 
training, on-the-job experience, and courses taken with the help 
of the program* Staff also perceived personal gains in self*" 
confidence/ understanding « and cc»nmunication skills* 

In-ho«ne supervision appears essential for home-based pro-- 
grams in view of the nature of the home visitors* jobs and their 
educational backgrounds* Findings showing variation in home 
visit frequency and in activities during home visits suggest 
tuat increased supervision could possibly improve the quality of 
the' program* 

Many projects^ employed specialists in a' number of areas and 
used professionals on a consulting basis* It was not possible to 
test statistically the contribution of staff specialiats to spe-^^ 
ci-fic areas of program effectiveness* yet it is clear that 
specialists improved the overall quality of program operations 
through* the support provided home visitors and direct services 
provided to families* Since specialists do increase project costs* 
however, care should be taiken to employ specialists that are most 
useful in relation to the needs of families served and to use 
occasional consultemts to supplement project staff* 



5* Efficiency in operation can be achieved by controlling 
the number of families served* 



Project size influences both program costs and program 
effectiveness* There is convincing evidence that costs per fam- 
ily can be substantially reduced by increasing enrollment to at 
least '80 families per project* Although total program costs 
would increase* em increase in enrollment from 50 to 80 families 
would result in a 14% reduction in per-family costs* Further 
increases in size would result in smaller cost advantages* e*g*, 
increasing enrollment from 8C to 110 families would only reduce 
per-family costs an additional 12%* 

The number of families p^r home visitor (an important cost 
factor) relates to program impact* It appears that visitors 
shoiad work with between 9 and 13 familieSf Wxen home visitors 
work with more than 13 families they make fewer visits pet family 
and the children gain less in school readiness .^nd language de- 
velopment* On the other hand* there is no app&.ent advantage to 
serving fewer than nine families per home visitor* Controlling 
the number of families served would allow programs to follow two 
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other implications that st^ from the findings: families should 
be visited three times per month and the home visit should last 
between 90 minutes and two hours. 



4. The typical school year (September ^ June} may represent 
the optimal program duration * 



A full two-year program is twice as expensive as a one-year 
programr and there is little evidence. that an additional year 
results in any Important additional benefits for children cr 
parents* Increasing program length from a school year to a 
full year is accomplished by providing services through , the 
summer* Evidence suggests that it is more difficult to main- 
tain program operations -during the summer months and that summer 
programs did not substantially increase^ the benefits to families* 
For a given level of funding 50% more families can be served in 
a 7* or 8-month program than in a full year program*^ Although 
the optimal program duration will vary with the family being 
served r in general r a school-year program seems the most suitable 
.as long as some services are provided to families on an as-needed 
basis during the summer* 

Since these implications result partly from an analysis of 
short-range program effectSr it is important to recognize the 
possibility that a longer program may produce longer lasting 
effects. It might be possible for projects to develop criteria 
for deciding how long each family should be involved in the 
program* These criteria might include the degree of independence 
the family achieves and parenting skills that are acquired* 

It should be pointed out that operating programs only during 
the September to June period results in home visitors being 
unemployed during the summer months* Home visitors received 
very low salaries at most local projects* Siunmer unemployment ■ 
would impose an additional financial burden on them and mijht 
make it increasingly difficult for projects to retain the most 
effective staff members* 

Implications for Federal Demonstration Programs 

Demonstration programs such as Home Start provide a means of 
testing programs^ learning how they might operate^ and obtaining 
some indication of their effectiveness* Just within the Office 
of Child Development^ several such demonstration programs have 
been conducted in recent years (Planned Variation Head Startr 
Parent Child Centers^ parent Child Development Centersr Child 
and Family Resource Program^ and Project Developmental Continuity^ 
to name a few) . The evaluations conducted on these programs are 
designed primarily to provide inf oiination aboat the program it- 
self. At the conclusion of the Home start program r however r it 
seems appropriate to discuss briisfly some issues that relate to 
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the conduct of demonstration j^rograms in general* In the Home 
Start evaluation a number of methodological goals were accom*^ 
plished and the experience may be relevant to future evaluations 
of this nature* - 



i« The 0valuation should hegin simuj^taneoualy withf if not ^ 
before^ impl0m0ntation of the demonstration p^rogram* 



The Home Start evaluation schedule permitted time for selec* 
tion and pilot testing of measures before actual evaluation data 
had to be collected* This was accoanplished during, the startrup \ 
period of the deroonstratibn program which gave projects an oppor* 
tunity to get off the ground without intensive evaluation^ If 
demonstration programs include start*up phaseS/ it. is Important , 
that this time be used for developing or refining evaluation pro*^ 
cedures* . 



2* Both process and impact data must t>e collected for a 
meaningful assessment of the total project* 



It is often easiest to measure indices of program success or 
failure/ but without measures of the processes of prpgram imple*^ 
mentation and operation/ the impact data cannot b6 explained* At 
both the process and impact levels/ a variety of ;iiiethodologies ^ 
need to be emiployed to obtain as broad and c<»iiiprehensive a picture 
rf the program as possible* On tHe process sldbe; lAftthoidologies; 
.?an include program case studies/ interviews/, obidtyations and 
record keeping systems* Impact data can also cdmcf^from a variety 
of sources**interview8/ testS/ ratings* Some of the most valuable 
findings are possible when relationships between process and iia» 
pact can be examined* 

Program successes with selected individual program partici*- 
pants should be documented to suppl<^nt research findings and 
to provide a more comprehensive insight into program impact* 
Descriptive details highlight the experiences of and changes in 
families not measured by more traditional assessment procedures* 



J* A careful cost analysis is essential if findings are 
to be applicable to future programs* 



As important as knowledge of program effects might be/ its 
usefulness is limited without information about the costs of 
producing the effects* The best program in the world might 
be prohibitively expensive^ And even more valuable than overall 
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cos^s is a cost analysis that is able to identify costs attrib* 
utable to various phases of the program or to each of the program 
components* If other progranis (such as the Head Start projects 
in Home Start commimities) are available to serve as n^eaningful 
comparisons/ an ana|.ys^^ of the relative costs and effects of the 
two programs is especially helpful for arriving at recommendations 
for policies a££ectiny future programs, 

i 

4, Random assignment of eligible participants to program and 
control groups adds considerable power to the design and 
is feasible under certain conditions* 



In the Home Start program^ the idea of a waiting list was 
compatible with the program philosophy and with local conditions* 
Since vaoTe families were available than could be servediby the 
program in one year/ twice as many were recruited axiui li^lf 
(selected at random) were asked to wait one year before ehter^ 
ing the program* Thus the re<}uirements of the evaluation design 
could be met while not denying service to anyone. 



5. A sample of projects can provide meaningful evaluation 
data so long as information is obtained on the general" 
izability of the findings* 



Of the 16 projects in the national demonstration, onl^ 
six were included in the summative evaluation* But since informa** 
tion on program process was available for all 16 projects^ it 
was possible to determine that the six summative projects were 
representative of the national program* 



6* The funding level of demonstration projects should be 
adjusted to regional variations in the cost^of^^living 
index. 



Since project quality is potentially directly related to 
cost of operation, operations are made effectively different 
across sites when their real costs vary. In the typical 
demonstration project; including Home Start, the same level 
of funding is provided all projects. Because o£ v^u^i^tlons 
in the local cost-of-living index, this results in site-to-site 
variation in the ability to provide services to families* For 
the same federal dollar, the site in large, eastern metropolitan 
centers cannot purchase as many staff (for example) as the rural 
southern site* With the large number of site-to-site differences 
that exist for other reasons,- controlling the cost factor would 
add a measure of uniformity to^ the projects being evaluated* 
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Conclusions 



Thfr findings have Incticated that Home Stixt-^^f^Bi^' 
and Chapter IX has spelled out the, naaning of sti^^^f^ 
o£ the neafui^es VLsed ahd,c^oii|pari$oii^ j^Ade inr"^^^^ 
seems appropriate tio conclude this r«^^^ witi^ ,a J]iyi^jiiBCtti|%^ 
of the.generalij8^Uity of .thes>;.fij«Ji,iiigs-;a»^|S 

The jfesttilif of tm .ifpa^^^ixv^^ 
of the afftfuiq^ti^s UQde^J3^ihO: #^3pi3f 
and circuA^tanees ^at ^^'ovm^ tli^ Jg^rpilH^l^lMj 
evaluated. TKere aice ^e^^asio ..ooi^i4tt)i^i^< ^ 
be kept in^iniiid men itit«spM€im ^i^f^ipft 

■ First, .tihs'. ^ptfifgi^vm '^pLf^j^Mim 
strationtr the;,l6 tf6tae^i8t^ivpr«i«^tf^. i 
attention :it'Q*^4«44«*t#a: ^^^^MWk.^ 
typical i<?f large-scale «*rtfii^tt»rtf^g^ 
that 4ocal .ftead Sta^t, pr<>Sgt»3>»^f*iip^ 
Opt'ion do not benefit f in^ml/tibA^ is|d^/^''^ 
a national officei the aene^^aXlia&f' 



be questionm^ 




Second,. Konte Start ^enlohs^a^tei^^ 
home-based program^, ' Proj»^tt -•^^'^ 
of home a»d ,oent«]^ 
duration, -inl^e^lty 
may achieve^rdilCj^e " 

' "* ' " ' " "' ^' 
. ^Thiird^' the selection- of '-the;'^e^|is,'^lit^^ 
'iiirtits the 'gener^ii«abltit^' of ::tli«'^^n^ • 
were selected throu^/a re^iontUvn^i^'I^P^' P^^^ 
standard national criteria, the. :site]iji^ma^v^uj|^ th0 
beat, the most cooperative,, or th^ "mbWt \^li;t'£ii;Ml|^^^^^ 
ones -in ^theiir regions. . Whatever' ^i^^^it^i'-?^ 
it is very likely that a syst^u^t^^^lly .dra^»^7^^4^e|t<^nt.atlye 
sampjJle of Head Start; grantees', thr:aughdttk^^^ ^e ^ 

different froit the. saiD{fle^ studied: in ^th»^^o^^^ 



These three points are raised^ as r^M^^^^^^lf^^ 
These factors by .no means invalidate ,i]le^stVdy^<Kf^ 
was-designed andvjc'arried out^ft/suphV^'^^^y?'"^^ •--..■'■-%.«!^ 
information is available on the tc^atactei^fst^ • 
Start sites-, the ^^latione inVot^^^ vik- 1^*^-^^ -and the 

nature of projeot^ppea^Ationsw ;it ^t*■>;hc^diJ!^at^ghMvi^nl 
will, facilitate aj^propriate interpretati.6iib;^,Mi/|i|^^^ • ' 

findings. by those.t^b^-are'^terestcid in ijmr'Q^it^^^§bqri^i^' '^"^'l^fih 
for cMIdrett^/and faiaijie-s,; .. ^\y'' ^T^-:::}t'.f4^MW^ y ■ ' 
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APPENDIX A 
HOME STABT ' PROGRAM OVERVIEW 



Sofne basic facts about the Home Start Pjrogram were presented 
in Chapter I* To provide the reaider with a more cpm]^rehensive 
overview of the program and how individual projects operated, 
some key aspects are discussed here in more detail* Th^-over* 
view section concludes with answers to commonly aslced jijuestions 
about Home Start* — . , ,\ r ' 

Sixteen projects located thtbughbut-^e bftited Stjates^ Ver6 
funded as part of the National Demonatraliioh Prpgfam 
They operated in a variety of settings* . Iliiie.;qf ;th^:^s<w^ ^ 
families primarily living in rural area^r and l^e;,r^^a£^ were \ , 
considered urban or reached out to^urban"" or-a and 
rural families* Participating families ji:e£^2:;esont^d:^ di:^f ereht 
ethnic and cultural backgrounds including wJbltW 
Eskimo, Navajo, Migrant, Spanish-Speaking *n4 Orieni^^ 
half (61%) of the families seinred were^,nraiA>ers of ;mi^ 

Home Start was a program with f our distinct dprt^c^^ 
designed to meet the e^aucationaL, nutritional, hea^il^ li}^. p^ 
chological/social needs of program ,partlcipahts^,_.J^^^t _in^^ 
ment was not included as'^a'^ToMie Statrt coi^ 
the foundation of the entire program." ^^"^ 

Education Component ^ - \ . - 

The educational c<»nponent of Hqme Start m% design 
marily to help parents become BK>re e£feictiv^a in tlte|^^^^ 
the first and most important **educatpif8*^'pt 1^ 
Time was devoted in the home visit.to make parc^f:^ ^ai^ 
importance of spending time with the child each day 
cuss the child's experiencesr feelings ari4 t&oughtfe,* J^^l^wte 
mental stages of the child also were luidre&sed^^bot^'in the home 
visit and in group meetings when parents got tpgetKer: to discuss 
a variety of topics relating to the'chlld. - ^ ' 

Home visits and group meetings also were de^igned/to help 
parents to use elements in the child's typicaV .^pviro as . 

teaching tools and to turn everyday experiences i^itiQ /constructive 
learning experiences for the child. Reminding /parents TabOut the 
teaching potential of all household tadks and familijaLxiiising them" 
with the many objects in the home that could be used as- instruc- 
tional materials we£:e two ways home visitor's tried to get parents 
more involved with their child Qhd to provide them With a stimulat- 
ing environment. Many home visitors brought m^telrlals for use in 
the home visit activities , but they were simple and designed to 



See footnote on page 7* 
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show the parent how to make them cheaply or at no cost at home* 
Some projects conducted toy making workshops for parents while 
others tQoR families to a library to obtain books, for their 
children or made arrangements for a booXnK^bile to mak^si ppcasional 
visits to the community* About half of the educational activities 
were designed primarily to prepare the child for school* 

Health Component 

Home Start families were to receive the same healtii servicer 
as provided to children ^^nrolled in Bead^tart* One o|!,. the oh^y'^. 
jectives of the program^ as a result, ;v&b to ihsur^ th^t £ocal^;'\^ 
children received physical and dental e^iandnations/^^.^^i^ 
and needed follow-up care. Services were provide^: w 
community agencies at no' cost or for a reduced fiiev/>^^ 
jects insisted that parents be present when t^4:h£ 
services to encourage more regular visits ^rariged^ by |aiftlX^^^ 
th^selves\ Transportation to he^3,th ser^ce% fte^e^^ 
a problem for^families* To insure that prp^r^~obj)et^ 
met staff took families to th6 health s^ryices or::'inv|L\^ 
stances brought the services to the families or^^jiirra^ ttie 
two to meet in a central location* Proji^ts also hi^lped families 
eligible for Medicaid to aEqE>ly for the service and^o ]H;eep .basic 
health records on the child* u ^ - 

Many of the activities conducted as part of the home visit 
focused on preventive medicine, hygiene and safety* ilictivities 
frequently involved the focal children, preparing theqi f or dootor 
and dentist visits and getting them used to washing their" hands 
and brushing their teetib* Health education also was addressed 
in group meetings for parents and focal children* 

Nutrition Component 

The nutrition component of Home Start was geared primarily 
to improving children's diets* Since no funds were available 
to subsidize family food budgets or to provide. families with 
nutritious meals, this component had primarily an educational 
emphasis* Home visitors made parents aware of the importance 
of good eating habits and showed th^ how they relate to good 
health and overall child growth and development* Information 
was presented about basic food groups, food buying;^ ;c^reparation 
and preservation both in home visits and group meetings, 
Srnphasis was placed on augmenting the ethnic/cultural bating 
habits of families rather than toteaiy changing them* Some 
projects assessed family food intake, made suggestions for 
improvements in diets and provided vitamins for the focal 
children* Children frequently were involved in nutrition 
activities to get them to try different foods and to make 
them aware of healthy foods to eat* Some families were put 
in touch with emergency food programs and charitable organize^ 
tions or ac^lied through the help of Home Start for food stamps. 
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Social/PsychologicAl Coroponent 

This c<»nponent was designed to adi3;ces^ 4 wi^e arj^ay o£ needs 
o£ the^£amily^ such JEor Intproyed houpina> CTtpXojptBn^,; legal 
se^^ices and counsel Jlngr, Hoclal/^sychblc^ical'^ ^ aet 
priiftarily Jby putting families in touch with^^ 
in. the community. Activities ^n -the home. v:isits.Vea:e..'S{ea4.gned 
not only to acquaint faffldiielsV^ith^a^ 

'ftncotirage families to make contacts:th«iii^elv«: dSi^ more 
independent in meeting" family needs. , ; Group, ac^^ 
Opportunities for both parents and children^ for s^ial^a^ion 

^outside the home arid to meet with othetfs in similar^^^^ 

Home Start linked up with existing comunity. reaburces to 
meet a variety of family needs. During the eoiirse of; one year 
(1973*74), famiixep we3pe referred an; ayera^ seyen itimes**** 
four times" for healthi heeds (primarny of thje f<;^a^^^ 
tvice for social/psycholbgical needs of the famiiy> end^p^ for 
nutrition. Half of the families al^o were /referred once for 
educational heeds of either the ^isirent or. the child. Ho^t (63%) 
of the referrals were made for focal children. 



Commonly Asked Questions About -Home Start 

• What kind of families did projects serve? 

The focal parent served by Home Start was most often the 
mother* She was about 30 yeairs old and had between 3 and 
4 children. About a quainter of the mothers hadv^raduated 
from high school* In general^ parents represented a low 
socio-economic status; the average Home Start family in- 
come was less than $6/000 per year to support a' family 
of four or five. In many families (41%) neither parent 
was employed and about a quarter of the families were 
single*parent households. 

• How large was Hbme Start overall? * 

"- Families * ; The program reached an average of 1,183 
families per quarter* During the second year of Home 
Start/ a total of ^#020 families were sejnred with a 
total of 3/871 children under five. Of thede, 2,561 
were focal children* 

—Staff* 195 staff were working with Home Start during 
the final phase of the demonstration program (or one 
staff member per six families) « There were 107 home 
visitors among the total staff each serving from 10 to 
11 families* 
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What VAS the ^typical^ Home start Project Xike? 

-^ Families ; During the second year ot Hcme^ Start, pror. 
jects each served an average of 70 families per quarter 
and reached 130 children between the ages of zero aiid 
five. Of these, 84 were focal children. On the average, 
a total of 126 different families participated in each 
project during a year, indicating a relatively high 
turnover rath as kindergarten -age children left the 
project in the fall. 

-^-Staff : The typical HORte Start project had twelve staff 
members t a director, three specialists, a secretary/ 
bookkeeper and seven home visitors. The typical home 
visitor was a fematle who was 34 years old, had ccwpleted 
high school and spent some time in college. Before 
joining the Home Start project, she was employed in a 
job which in some way related to her work, aa a home 
visitor. She seirved between 10 and IX families. 

What kinds of searvices did Home starfe<^families receive? 

" Hoflfte Visits t' The typical home visit occurred twice a 
month and lasted one hour and a half. Although the 
home viBitor, focal child and the focal parent always 
participated in home visits, in 85% of the homes in 
which there were siblings, they were also involved in 
home visiting activities. Over half of the hame visit 
time addressed child activities, with most of this time 
being spent on either school readiness or physical de-*- 
velopment. The remainder of the home visit was devoted 
to parent activities, emphasizing primarily parental 
concerns. 

During the home visit, the home visitor interacted with 
the focal child about a third of the time and also a 
third with the focal parents. Host of the remaining 
time was spent in three-way interactions. Home visitors 
encouraged parents and children to work together on Home 
Start*type activities between home visits. 

— Other Home Start Activities : Although the primary anpha- 
sis of the program was the home visit, projects planned 
other activities for famili:es, such as group meetings for 
children and/or parents and parent Policy Council meet** 
ings. Occasionally, home visitors and other staff pro-- 
vided transportation for families enabling them to visit 
a doctor, dentist, or social seinrice agency. 
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'^' ^oWBiitmity sefcVi:ceg r~ Fawiiiee jrisceiyed a-hijpb^jr of 
oranwimity seirytcea thtou^h, .gceiE^rails l^ci^ j<iiiUitoTn 
and other stail£. The. focaT chud was ..t^^-l^iA^Cry^ 
recipient of TetetT&X/it^^ice!»-'-f' rec^l.y±ng jnjt^e"^ 
half of all ref^rrkia" «»de.uf; Dwring i^e-^f « 
of Home Start, ah averig^ t, QiI8:;ji?ie£« 
resulted In service dellye^ w«»c0 inatdet £»ei^ .^|^ jfect . 

What were the t>er>*faroily costs oI'lProvidinq H^e Start 
ser vice s"? - ■ .■ . ■ ' ' "y^' " 

Project and per-famlly costs for one, year of Hoinei'siart 
services were as^ follovm: - ^ . . , 

Per. Project . . Per^Ftoily 

Federal Expenditures $ 103;510 ■ ^ $ '1/400 

Iiocal Contributions 25>880 : :^ ' 350 ; 

Total Cost ' $ 129»39b ;:$a:j750 

Personnel costs rej^resented approximately 7S% -of -fecal 
project's costs; 6% was spent on materials/supplied', 
6% on travel to home Visits, and ii% fok ptJier coatts 
(e.g., space and eguipnnenjb} . ' \ 
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APPENDIX B 



EVALUATION DESIGN AND METHODOLOGY . 

The, National Home Start evaluation was carried out by the 
High/Scope Educational Itesearch Foundation of Ypsilanti,/ 
Michigan as th^ prime contracitor and Ab^ Assopiates/Inc^ of 
Cambridge, Massachusetts (as sub^contractor)^,^. eyaluation 
consisted of three con^onents which were considered^ 
tary means of viewing the effects of Hwae Start;:, a prjiigjram 
and process evaluation; a summative or: Qutdoioe ^valui^tlon; 
and a cost-effectiveness evaluation. The. three cojof^oh^ts^'of 
the evaluation are described in detail: below. > ^ ^ 

^ Program and Process. Evaluation 

This aspect of the evaluation prov'ided basic, descriptive 
information about key aspects of indiyidual Home Start^pjE^oje^ 
such as project organization/ .staff i||ig pa^ 

cations, time-use pattern^,; pro^rf^' participant aiid 'staff char- 
acteristics, program conq^onentS/ l^e heme visit/ goa^s and . 
objectives, and seinrices. ■ , ^ 

Two site visits were, di^iicted yearly to obtain program- 
matic data from the six projiecfsi selected for particlipation 
in the summative evaluation. Non-summative pjrojectW received 
site visits only once a year. Trained field staff conducted 
in-depth interviews with project staff during €he sit^. visits 
to obtain data on a variety of programmatic aspects and Issues. 
Interview data were supplemented by self r^orts from staff and 
quarterly Home Start Information System reports* These reports 
provided some basic statistics about the projects— family and 
staff characteristics / services provided to families, aa well as 
some information about financial expenditures. This information 
was gathered by local project staff as part of their routine 
record keeping activities. 

To obtain information about the principal mechanism for 
searvice delivery in home-based programs"the home visit~an 
observation instrument was developed. The instrument captured 
information about the content of home visit activities and in- 
teraction patterns between participants. Information also was 
obtained about plans for the visit, home visit length, location 



Summative projects were located in Huntsville, Alabama; 
Dardanelle, Arkansas; Wichita, ^ msas; Cleveland, Ohio; 
Houston, Texas; and Parkersburg, West Virginia. 
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of activities r materials used and amount of activity fpllovmp 
during subsequent home visits. Home visits to as many as three 
families/per home visitor (or a total of 133 home visits) were 
observed by local commiunity interviewers twice a year in the 
six sumniative projects.. . . . . . , . : „ 

The collection and emalyses of these data resulte4 in a: 
series of evaluation reports which explored a number of issues 
germane to program operation^ and pi^cesses^ deyeral <!«iJ|j^ ati»iy. 
reports highlighting interesting aspects the program^ and[,r-.U.r 
the Hb mesbook which provides a conqp^ehensive ir^sight into ^Ho^eV 
baseST ^rogtam operations. Summaries pt the Home Siart |;^£d(i^ 
tion Systean report^ frpm local projects were prepared tb;|[f<^|te:^^^^ *iS 
the national Office with quarterly statistical infp^rBiia^ipnvi^^ 
the. d^oonstration/program^ ,\ ^ . , ^/ i^^^^^^^^^ 



In summaryr the program/process evaluation na^^decel^l^^i:!^^^ 
obtain factual inf ormati(»»^«^ the pirojeqt^r tpVlB^ 
tions for program iinpro^eltt^ts_ and to gauge i;he^i^^^ 
implemehtatiqn of reoommenda:bionSr as vellfai^lpVovi^ 
te^Ft for summative (outcbAell 'findihgslj .Xhife jEaicitiiii^^^^ . 
and recommendations included in the aeyen "evalimt^^^^^^ . 
frequently were used by National Of^flce; staff ^^^^^^ 
technical assistance and ^i^alning visits ^bo local pxo^i^ 



Summative Evaluation . 

The summative evaluation provided; ihi^orma^^ 
Start*s overall effectiveness by measuring eharige^^^^ 
and children. In this section the design r jsak^ ; 
data collection and analysis plan of the suittida^^iye eVaiiiJ^ , 
are reviewed. . ^ ■ . ; \ ' 

Design 

The design of the evaluation study, is illustrated .i|i, V 
Figure B-1. Three groilps were pretested (fall Idti) and re*^ 
testedjafter 7 months (spring 1974)^ 12 months (f^all ^I974|r 
and after 20 months (spring 1975). The Home Start and;c<:^ntrol 
groups consisted of families recruited by the projects and ^ 
randomly assigned to one of those groups. The Head Start. group 
was obtained from Head Start programs in the Home Start commun- 
ities, ' [ \ 

The control group entered the Home Start program in fall 
ld74 and experienced one year of the programi* New groups of 
Home Start and Head Start families were added in fall 1974 to 
supplement the groups already in the evaluation. 

Whereas all 16 sites participated in the formative evalua-* 
tion^ only sist were involved in the summative evaluation. 
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Although an attempt was made to select representative sites 
for Inclusion in the sumroative evaluation, practical consider* 
ations also entered In (e*g.^ site start^^up delays, travel 
costs for the evaluation) so that the six sites were not 
randomly chosen from the 16. Nevertheless, data collected as 
part of the infomation system on all 16 sites indicated that 
there were no major differences between the summative sites 
and the other ten* 

Sample 

For the pretest, an -^^ttempt was made to include 40 families 
in each of three groups a. "'^ch site: Home Start, control and 
Head Start. In most sites 40 was the maximum nuinber of Home 
Start openings available (where a site had more than 40 openings 
in the program, 40 were randomly selected from the total number) . 
Fewer than 40 families per group were involved in the evaluation 
in some projects because a large proportion of their families 
were Spanish speaking. Non^English speaking families were not 
included in the evaluation activities. 

" The control families were very similar to. the Home Start 
families; the two groups did not differ significantly on any of 
the scale scores used in the analyses. This was fortunate since, 
strictly speaking, the assignment was not random due to a number 
of problems in the field. A complete discussion of these prob- 
lems and the reasons for concluding that there were no syst^atic 
differences between the two groups can be found in Interim 
Report IV , Summative Evaluation Results, pp. 13-17.. 

Families were not randomly assigned to Head Start, and fall 
1973 data indicated that in the four sites included in these 
analyses the two programs served very different populations. In 
general, Head Start families were less disadvantaged than Home 
Start families. To be eligible for testing, Head Start children 
were to be the same age as the entering Home Start children from 
that site, come from the same geographical regions and not have 
any prior preschool experience. For several reasons, it was not 
always possible to meet these criteria: Home Start usually served 
more counties within a region than Head Start: Head Start children 
had to live near a road, within busing distance of a center; and 
Head Start programs were often three-year programs, starting 
children at a younger age than Home Start* 

One concern in a study spanning two years is whether attrition 
from the sample would affect the original random assignment in' 
any way. At each test point (spring 1974, fall 1974, and spring 
1975} families who dropped were compared with the remaining fam- 
ilies on their entering scores. A few differences were observed 
on some measures at different time points, but in general sample 
attrition appears not to have added any serious bias to the group 
comparisons. The amount of attrition was extensive, however, with 
42% of the Home Start children remaining by spring 1975 from the 
2^^1 who were tested in fall 1973; 44% of the original 162 control 
children; and 43% of the original 143 Head Start sample. 



Suntnicitive Measures 



To provide a broad assessnient ot progreim effects on children 
and parents, 11 measures were selected: two children's tests, 
two child rating scales coiapleted by adults, one mother rating 
scale completed 1^ the community interviewer, three parent ques« 
tionnaires, ^parent*child interaction measure and child height 
aiid weight. The measures listed below are described in some . 
detail in Exhibit B-1. ■ 

e Preschool Inventory (PSI) 

e Denver Developmental Screening Test (DOST) . 

• Child 8*Block Task 

• Schaefer Behavior Inventory ' (SBI) 

• Pupil Observation Checklist (POCI-) . 

• High/Scope Home Eiivironment Scale (H/S HES) 

• Mother Behavior Observation Scale (MBOS) 
e Parent Inteanriew 

• Child Food Intake Questionnaire 
e 8-Block Sort Task 

• Height and Weight 

Fifty^six variables were derived from these 11 ixteasures for 
use in assessing program outcomes. The variables have been cate** 
gorized into nine Home Start goal areas for presenting findings. 
Five of them are child goal areas: school readiness, social^ 
emotional developi^ent, physical develcpsient , nutrition, and med* 
ical care. (See Exhibit B*2 for a more detailed description of 
goal^areas.) Four of them are parent goal areas: mother/child 
relationship, mother as teacher, home materials for the child, 
and use of ccxmnunity resources (Exhibit B*3) . 

The full range of contCT^porary criteria were taken into 
account in selecting the measures. Among them were: completely 
new measures could not be developed/ total testing time had to 
be reasonable/ individual items had to be interpretable, instru- 
' ments had to measure national or local objectives, measures had 
to be apqpropriate to the population, tests and intearviews had 
to be^ practical to administer^ seme measures should have been 
used in other evaluations, and the measures had to have good 
psychometric characteristics. 

Data Collection 

The measures were administered to ^eunilies by para*-' 
professional interviewers selected from the Home Start communi- 
ties and brought together for training by Abt Associates staff. 
There were three to five COTmiuhity interviewers at each site 
and one locally hired and specially trained site coordinator 
who assisted in training/ monitoring/ and scheduling* All test*- 
ing and inteinriewing was done in the home for Home Start and 
control families and in centers for most of the Head Start 
children. Families were assigned to community inteirviewers 
randomly in urban sites, and by geographic region in rural 
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sites to reduce costs* All protocols were forwarded weekly ^ 
to the Coordinator of Field Oper^l^ions at Abt Associates who 
checked all 1:ests and interviews for completeness and obvious 
scoring errors before sending them to the High/Scope Founda** 
tion for processing and analysis* 

Data Analysis 

Figure B*l shows what comparisons were made for the main 
analyses reported in Chapter II* 

Four basic sets of analyses have been carried oUt* Birst, 
descriptive data on the number of fatmilies and children, missing 
data, conditions of testing, and other information needed to 
assess data collection quality were compiled* At every time 
point (and during the pilot year, as well) item emaly_ses were 
performed for individual measures; these included item response 
distributions, percent passing, internal consistency reliability,. 
ii:em intercorrelations and principal components factor emalyses* 
These analyses provided a continuing assessment of the psycho* 
metric qualities of the measures* A third set of analyses has 
also been completed at each' time point; analyses of scale 
scoresi these included calculations of scale score or total 
score means for each measure, standard deviations, correlations 
betwet:!n scores, and factor analyses of all scale scores in the 
battery* The fourth set of analyses was conducted to assess 
program impact* These analyses have been done in spring 1974 
(seven*month outcomes) , fall 1974 (12-month outcomes) and 
spring 1975 (20*month outcomes), and have included analyses of 
variance and covariance, multivariate analyses of covariance 
and regression* 



Cost-Effectiveness Evaluation 

Cost data were obtained over the three-year period both 
from Head Start and Home Start projects* The collection of 
cost data was more extensive in the Home Start projects where 
information on both federal expenditures and levered resources 
were obtained to provide a comprehensive overview of program 
cost* The types and quantities of benefits produced by the 
two programs, and the number^of participants that benefits 
could be extended to for a given level of public spending were 
can^ared to determine whether Home Start represented as cost- 
effective a program as Head Start* 

.The cost^ef fectiveness evaluation also was designed to 
examine the relationship between program/process / cost and 
outcome findings and to formulate recommendations for improving 
program efficiency and for policy decisions at the national, 
regional and local levels* 
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EXHIBIT B^l 
DESCRIPTION OF SUMMATIVE MEASURES 



Brief descriptions of each of the child and parent measures 
used in the stimulative evaluation are included in this Exhibit. 
The child measures listed in Exhibit B"2 are organized into five 
program goal areas for children. Parent measures are grouped 
into four goal areas and are presented in Exhibit B*-3. 



Child Measures 

Preschool Inventory (PSI ) 

The PSI is a general measure of children's achievement in 
areas that are often regarded as necessary for success in school. 
Children are asked questions of general knowledge (e.g.^ "What 
does a dentist do?**) and basic concepts (e.g.^ "Put the blue car 
under the green box''). The PSI used in the Hone Start evaluation 
is a 32*it^ adaptation of the 64^-item Cooperative Preschool 
Inventory published by the Educational Testing Service. The 
32-ltem version was originally adopted for the Head Start Planned 
Variation study and was selected for use in the Home Start 
evaluation partly because of its previous use in a national 
evaluation. 



Denver Developmental Screening Test (DDST ) 

The DDST was designed to aid in the early discovery of 
developmental problems in four areas: Pine Motor Adaptive^ 
Language^ Gross Hotor^ and Personal'-Social. It is primarily 
intended to be used as a diagnostic screening procedure with 
individual children to identify those who are developmentally 
delayed. 

Since the DDST includes it^s that are applicable for 
children who range in age from two weeks to six yearsr items 
suitable for the Home Start age range had to be selected. 
This was done by examining the norms published in the DDST 
Manual and selecting items that would discriminate among 
children in the 3** to 6-year-old range. For the fall 1972 

46 



45 



pilot testing, 32 iiiems were selected that ranged ih diffi* 
culty* according to the norms* from those that 90% of the 
3*year*olds passed to those that no child in this a^e group 
would be expected to pass* A few ODST items falling in this 
range were not included since they duplicated FSI iimns* 
Three items found to be deficient ijn' the s^incf .ej;aJ^^^ 
were deleted in an attempt to make the' ihstiHimen^ n^^^ 
and more sensitive to age changes* In addltionV revisions 
were inade in a few it^s; ihstrtictiond to c<»muhity inter 
viewers in the test booklet were clarified^ and the ^rder o£ 
administering .the subscales was revised so that JFihe Motor 
it^s-were administered first* Experience of the testes 
authors suggested that rapport with children" in tJiis age" 
group might be better established if these items mre given 
first«^ As administered ^or this evaXuatioiif answe»; to the 
FersonaX*Social scale items were provided by the .mother* / the 
other three scales were administered directly €o the children* 
The test was not designed to yield scale scores* but for the 
purposes of the Home Start evaluation « scale scores were 
obtained by adding together items within each of the four 
separate areas of ftoictioning* 



Child Food Intake Questionnaire 

The Child Food Intake Questionnaire was developed in 
spring 1973 to obtain a quantitative and qualitative index of 
food consultation* It utilized a system of 24*hour ^recall 
whereby mothers weref asked to report all foods eaten by their 
child on the preceding day* Specifically, the^ mother was asKed 
what the focal child ate for breakfast, lunch and dinner, and 
any snacks in between* The interviewer probed for fixact quanti 
ties of all foods* To help the mother estimate quantities of 
food more accurately and to help the tester reliably record 
the mother's responses, the tester used plastic, child*-size 
beef patties (2 ounces) , glasses (4 ounces and 8 ounces) and 
bowls (10 ounces) marked at one-fourth cup intervals, and 
tablespoons* The testers were instn^cted not to suggest **appro 
priate** amounts of food; rather, the mother was asked to point 
to markings on the glasses and bowls that indicated how much of 
a certain food the child had eaten* The tester mentioned 
particular foods only when probing for possible additions which 
might have been forgotten (such as iiiilk on dry cereal or 
lettuce on sandwiches) * An additional element was added to the 
Food Intake Questionnaire in fall 1973 by having community 
interviewers ask whether the child took vitamins* 



^Throughout the development of the ODST 'format used in the 
Home Start evalution. Or* William Frankenburg and Mrs* Alma 
Fandel have been extremely cooperative in helping to adapt 
their instrument* 
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The questionnaires were coded according to two sets of 
criteria. The first was based on the , to tail nu«U>er;;of '^servings*' 
eaten In each of seven food groups (milk, meat, . eggs, vitamin-A 
vegetables, breads, and cereals). A total Food Score was then 
derived by summing the number of servings across /food" grpups. 
The second-set of criteria provided qualitative infoAltiori by- 
setting a maximum score for each of the s^veh f oddT/^b.ups ba^ed 
on the nutritional . requirCTttents fojr'that^jgroup'. If the number 
of food servings was greater than the maxliium^ iScore— : 

for a particular food group, the maxim^ score >ras coined. Tho-\ 
scores for the seven groups were then summed to^^create a total 
Nutrition Score for each child. j_ . : 

Height and Weight ^ 

Information on the height and weight of childreri -in the 
sample was collected to assess physical. grpwiA and tQ , determine 
possible height and weight difference's among .groups*"- These are, 
particularly important data for addressing the question^ of 
initial group differences since height an(?, to ^a ^lesser extent, 
weight are general -indicators of physical growth alid^ large 
discrepancies from the norms may be related to nutritional 
status. 



Schaefer Behavior Inventory (SBI ) 

The SBI consists of 15 descriptive statements~iSf child 
behavior that are read to the child's parent. Two typical 
items are **Stays with a job until he finishes if and "Likes 
to take part in activities with others**. The mother indicates 
the degree to which- the description fits the child by responding 
on a seven point scale from "never** to **always**. The SBI con- 
tains three scales of five items each, labeled Task Orientation 
(TO), Extraversion-Introversion (EI), and Hostility-Tolerance 
(HT), 



Pupil Obsearvation Checklist (POOL ) 

Upon completion of testing and inteirviewihg, each community 
interviewer was asked to rate the child on a seven point scale 
consisting of 9 bipolar adjectives such as **resistive-cooperative 
and "quiet-talkative** The checklist has two scalee: Test 



A tenth item (**calm-excited**) was added tr ^he rating form 
in fall 1973 to conform to the rating sea- completed for 
the home obsearvationsr but is not included ^n the analysis 
of the POOL data* 
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O^rientation iteins pertaining to the child's behavior during the 
testing situation^ and Sociability items pertaining to the child's 
general overall behavior as seen by the testers^ 



8*Block Task 

A score was derived from the S^^'Block Task based on the 
child's placement and explanation at the end of the mother's 
teaching* This measure is described as part of the 8*Block 
Task description under the section on parent measures* 



Medical Care 

Information on medical care was collected as part of the 
Parent Interview (see Exhibit B-2) . 



Parent Measures 



High/Scope Heme Environment Scale (HES) 

The Home Environment Scale is a 37*item parent questionnaire 
designed to obtain information on the child's home environment* 
The final form of the HES was derived from the spring 1973 
testing* Twenty-nine of the items are "yes^no** questions on 
three different checklists and the rest are single. questions 
which present the mother with three responses from which to 
choose* Out of these 37 items ^ only 26 are used in the six 
scale analyses* Most of the extra items were included in- the 
questionnaire as fillers , since they were likely to be answered 
favorably by the mothers and thus contribute to a more pleasant 
interviewing experience* 



Mother Behavior Obseanration Scale (MBOS) 

The Mother Behavior Observation Scale is a 10-item obser- 
vation checklist filled out by the coimnunity interviewer fol* 
lowing the last visit to a family* The checklist provides 
three possible responses corresponding to the frequency that 
the behavior was observed (never, once or twice, and three 
times or more) , There are five items belonging to a supportive** 
behavior scale and four to a "punitive" scale* One item (amount 
of child's artwork displayed in the home) refers to behavior not 
directly observed, belongs to neither scale, and was not included 
in the analysis* This item also was not recorded for many of 
the Head start families as testing generally took place at the 
Head Start center* 
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Parent Interview (PI ) 

The Home Start Parent Xnteinriew was originally developed 
to obtain information about the child's medical history, the 
parent's involvement in activities outside the home, the par- 
ent's use of community resources and parental locus of control* 
It was also used as a vehicle for obtaining feedback from the 
parents on their reactions to the testing and interviewing. 



8-^Block Sort Task 

One of the more widely used procedures for assessing 
mother*child interaction in a teaching context is the 8*«Block 
Task developed by Hess and Shipman in their Chicago study of 
maternal teaching styles. The S-^Bloqk has been used in the 
Planned Variation Head Start evaluation and in the ETS^Head 
Start Longitudin^tl Study/ which was one of the reasons it was 
originally selected for use in the Home Start evaluation. 
Although the situation created by the task is artificial it 
does provide the opportunity for direct observation of the 
mother* s behavior that complements the verbal reports obtained 
from parents by the Home Environnient Scale, 

There are three stages in the 8'Block Task, The community 
interviewer guides the mother through the blocic sorting pro* 
cedure in a standardized way/ the mother is asked to teach the 
task to the child, and at the end the child is asked to demon- 
strate whether he has learned the principles according to which 
the blocks are sorted. 

In the fiist stage/ the community interviewer teaches the 
mother how to sort eight wooden blocks into four quadrants of a 
12** X 12** board. The blocks vary on four dimensions—height 
(tall or short) / mark (X or 0 on the ends of the blocks)/ color 
(red/ yelloW/ green, or blue) / and shape (rectangular or circular 
in cross*section} , The relevant dimensions for sorting are 
height and mark. In the second section of the task/ the mother 
teaches her child how to sort the blocks. Although the commun* 
ity interviewer proceeds through a series of discrete steps in 
a fixed order/ the mother is told she can teach the child in 
any way she wants. The third stage of the task begins when 
the mother tells the community interviewer that she is finished 
with her **teaching". The coimnunity interviewer then gives the 
child two new blocks (one at a time) and asks him to place them 
on the board in the group where they "belong**. The results of 
the child* s placements and his escplanations of the placements 
indicate whether the child has learned the sorting task and can 
generalize the sorting principle to new otjects that vary on 
the same dimensions. 

The complete task was tape recorded and coded. Three 
items of non-verbal behavior were coded by the interviewer: 
punishment/ mother moving blocks/ and child moving blocks. 
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BXHtBXT B^2 



CBUD KEAStFU$ 
imOttAL SOKE SZAKt ffVAtSUkTZM 

amid 197S ^ 



ft Pt— dwoi l&witorv. A i^aiurt of diildrta'tt 

f«f«t4t4 Oft iMcouftiy for oitccc«» ij^ ocfcool; 

o POST* LopiiMto Scalo , a moium of childxoa'o 
i61Uty to ttn4o»t«Dd apokoft Iviimio ood to 
' vifbally; . 



ft Mlodt Child Tik Seore . « Mtttuxo of dill4r«a*» 
«itilit7 to ocquiT* ibotract conctptt taoiht by ' 
tlio ttotiwr; 

o Mlock Child Talk SootOi « ot«»ur« of bov «<iiy 
t«ik rclfttod coiaaaoto cbildroa «aka Whllt aotlieto 
to«di tfc« to tort fovr kiodo of blockt Into groupo. 

Social*Eaotioaal IXfvttlop—ftt 

o SBI* Twk Orlentitioii Scale. * ttoaiuro of dtildr«n*a 
tMk InvolvtaMit md aotlvation to coi^ltto taiki; 



ft SBI EKtravwtion-Intgwraioit Seal*, « •tasurtt of 
c^Udrott** itueraat in relating to otbar po^lo; 

a SBI HOatiUty-Toltranca Sola, a naaauEa of dilld^ 
r«n*» ability to laf rain from tMtlonal outburatA 
«ban thtnga don't voxk out jnat right; 

a POST Faraonal'Soclal Scalo. a aoaaura of childtan'a 
^ilit^ to dma thattfolvai and to wix with othara; 

a WCL^ tB$t Oriantation Scala , a ftCMura of diild- 
roo'a taak involvtoent vhilt vorking with tba 
conmit^ inurviovar; 

a yoCL Sociaihility Scalo . a Mcaaura of tha laval of 
ckildran'a aoei^ interactioa vhila working with 
tba ooMunity intervievor. 

fhyaical Davalopaact 

a Eaigfat , ; 

a ypi fl^t: 

a gPsy Croia ttetor Scala . a »aaaur< of childrtn'a 
ability to coordinata moveMsit of tba vbola body 
to accoRpliah a task; 

a 1>DST Pina ttetor Seala. a aoaaura of ^ildran'a 
ability to parfoTB coaplax tfovaaanta irith por- 
tiooi of tba body. 



[W&ti &anvor fiavilopmital Scraoning T^at 
TflUt Sebaafittr Babnvior Inventory ^ ^ 

hWUi PttpU Obaarwtion CbaokUat O X 



Taat 
Taat 
Taat 

Obaarvation 

Rfiting Scala 
fating Seala 
fiating Scala 

tating Scala 
Eating Scala 

tating Scala 



CbiU 



Child 



Child 



Codor, fron 
audio tapa of 
MOthar 4 Child 



Kothar 
Ifotbtr 
Motbar 

Kothar 
Taatar 

Taatar 



Dtract* HaaauraMot Teatar 
Direct HaaaoroMnt ^«9tar 
tMMt Child 



Taat 



Child 
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EXHIBIT B*2y COOTIMOED 



CBXID KEAStfUS 



Itittittott <Poods «attn by th« ehild dorlng tli« pMt 
« Hllk Crtnxp itote (milk» ch«e0«t let cnn); 

• Iteit Croup •cofe (ttt«t«» p««niit lmtt«r» dried b««D* 

• IM Crw <tote <«gt«); 

• A*V»itablsi ecort (carrotit i^utth^ itwet 
potttoti); 

» Cltw Fyulti scoice (or«nst«» fr^fTiilti> 
tc«4to«}t 

• Br*4<U md Cewli (brt^i. c«t*4Xs> 

• Jfattitlon Total sccrm (lun of pteviotfi icoret); 

• vitMiiii <yt«/no>. 
Wedlol Cmto 

• iMtonlratlOtt Since Fall * n yei/no score indicating 
vbothar children h«ve had DPT, polio, or MtsUo 
IwuolMtions between fttU 197^ and spring 197?; 

• Mdntha Sjpca Last Doctor Viiit; 

• Hsason for Last Doctor Viiit (checkup or sottiething 
vrong); 

• Months Since Last Dentist Visit : 

• Hesson for Laet Dentist Visit (checkup or something 
VTOog); 



24 Boor lEacall Hochar 

24 Boor lacall Hothar 

24 fioor laeall Hothar 

24 Hour iacaU Kothar 

24 Bour lacall Katbar 

24 Hour Recall Hothar 

24 Hour lecall Hothar 

24 Hour Recall H&thar 

24 8our lacaU Hothar 

Quastiotmaira Hothar 

Quaationnalra Hdther 

qyaatiocmalra Hot&ar 

<}uaatioQnaira Hothar 

tkuaationnaire Hother 
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EXHIBIT B*-3 



mm 1575 



Kothtr imd Child lt<l«tltmihlp 

ft H/S HBS* Mrthgr InvolviMTOt Scal^* • ttUMitr^ of 
how oft«D sothcr* spcad tiM with th«lr cbildr«n 
la fMMt pl««9«at comrMtloD* «ad otfa«r activl- 



citm cmidrm "help** choir Mothcis wltfa 
flli^rio houfl^Id toikst 

• MOt^ Sttfportlvo Scal^ » • Mwro of how oftoa 
■otlmrf praiMd or «iteour«tod chair dblldrcn In 
tho prtioacft of th« oosmmltr Intotvimr; 

• MPS Fiittitiv Sc*lg* ft WMurc of how often 
aotbon flcoXdodt chroatenod* or ctltieiaod cheir 
<liil4m In cho pnoonco of U» co«mttr Intor-* 
Yt«Mr« 

Hotbar — Toacfaor 

o H/8 HES Mother Teachgs Scalo * • «e«iuro of which 
oiiMtttary nadlDg «nd writing iklUs aothor* or* 
ttyliis to U«ch thoir chlldr«a» 

• S^Block Roqueat Talk, a vtoiuro of how f^qumtly 
nothor* ottonpt to oUcit child talk f ocualnft oa 
tha ralavaitt block aortiag dinaoiioiui of haight 
and nark; 

a ft^llotk Diagnostic , a naaaura of how wsf raqaaata 
tha aothar nakaa for talking of tha kind llkaly to 
gat tho dbild to think ibout tha aortlng ptobl«» 
(^pan^andad quaationa* rather than quaationa aaok** 
log the anawar about tha apaclfic dlaettaioaa)l 

a. ft^ilock Talk About* a aaaaura of how frequently 
nothara talk about tha relavant dlnanaiona ot the 
aortlag taaki 

a Mlock Inter act lona/Mlttute, a aaaatirc of tha 
average oMAber of tines par olnute chat the ^on* 
Yaraation ahlita fron tha nothar to tha child and 
irlca irara at 

a Mlock Mean length of String* a naaaura of the 
avaxaga avnber of uninterrupted nother coeMota* 
raflacting the extent to which tha aothar angagea 
in a aonolog; 

a »*BlQck Feedback, a naaaura of how frequently 
nothara react to children's coananta or block 
plaoananta <includea praiaa and ecknowledganant* 
ancauragenant, and correctiooa). 



Quaatlonnaira 



Qttaatiomaira 



Obaervation 



Obaarvetion 



Qoaationnatra 



Obaarvetion 



Obeervetien 



Obaervetion 



Cbaarvation 



Obaervation 



Obaervation 



Mother 



Mothar 



Tea tar 



Tea tar 



Hothar 



Coder « fron 
audio taf»e of 
Hothar 4 Child 



Coder, froQ 
midio tape of 
Mother 4 Child 



Coder, fron 
audio taf»e of 
Mother 4 Child 

Coder* fro« 
audio tape of 
Mother 4 Child 



Coder* fron 
audio tape of 
Hothar 4 Child 



Coder, fron 
audio tape of 
Hothar 4 Child 



^B/S K28: Hlgh/Scopa Eona Eovironnant ScaXe 
W>Ot Hothar Babafior Obaemtioa Scale 
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EXHIBIT B*3r CCmmjBD 



Ht<«tt» 



ItoctrloU fog the Child 

• E/S BES Book* Scale, e wietttte of how mmf childt«n'« 
book* «te in the botn, end hotr ofceo eoMOoe reede ^ 
otodae^ to the diiXdrent 

0 fl/g HIS yie»thlwE» Scele. e aeeeute of -how ainy of 
eoM e o w o, ordlnexy pleythinte «oet childreo Ulte 
eart in the 



gge of CoMiiftity >Mouro» 

0 Iffiifefe deoemtettCt 

0 Food Stm woft^tml 

0 He^iceidi 

0 food ccModltlee: 

0 Local hoepiteli 

0 ^hUo health clinic t 

e Mwitel health cXlnlc t 

0 FiMi^ cottfl—llng aftepclega 

0 Pl<<tted Fetenthood t 

0 Par coy ^proatent 

0 Ittcgeerlooal protfime; 

0 Leiel eld grogrip; 

0 Hotteine ettthi^rity; 

0 gtite CTploipcDt office; 

0 J6b t reining progy«a» * 

Omenigetlonel Total, e acoire Indiceting hov uaosr of the 

UOtfinc oegeaisetlonB aoiAe family neaibet belongs to^ 
perent-teecher' a organisation; boy scouts, girl acoutSt 
a«B Chiibf or other youth sxoups; chuxoh oraanisetlon or 
aoolal clu(b; and political organixatlon. 

Parent Locua of Control , eight a^^ettigna dealing vith 
practical problema to be solved; scored to indicate 
degree of personal responsibility for solving the problem* 



Qoeeciomtaite 



Qoaatioimaite 



ChmtlonnaiTa 
QeeetlMiaalta 
(Matiofmaixe 
itttaetiofmaira 
QyaatiMmaite 
Qoeatioimatte 
Qoaatlonaalre 
4)oeati«otiaiTe 
iloeatlofmalire 
Qoeattoaaaita 
Qoaationnaixe 
(Iveatioanaire 
Qeeetionaaire 
Qoeatlonnalte 
QeaatioQnaire 

Queatiamaire 



Xnterriev 



iaepottdent 



Xochar 



Hothee 



Hochee 
Itethae 
Methee 
Hptbet 
Hotliae 
Kotber 
Hother 
Hother 
ICothee 
Methee 
Hothee 
Hotber 
Hothee 
Hothee 
Hochee 

Kother 



Mother 
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APPENDIX C 
INDEX TO HOMfi START EVALUATION REPORTS 



A list of reports that were prepared during the three 
and a half years of the Home Start evaluation follows. 
Several, of these reports are available from the ERIC 
Clearingh07ise on Early Childhood Education and may be 
obtained bv writing to the ERIC Document Reproduction 
Service/ 4936 Fairmont Avenue^ Bethesda/ Harylaprid 20014/ 
specifying the ERIC document number for the report 
desired. Volumes not yet in ERIC are available at cost 
from the High/Scope Educational Research Foundation, 
600 North River Street, Ypsilan^ii, Michigan 48197. 

Background information or further details on the 
contents of all previous Home Start evaluation reports 
are provided in a detailed i;nde^ of 32 topics which follows 
the listing of evaluation ■t%^i;.ts. The index guides 
readers to issues a(idressecl"in^ tTie reports which are of 
specific interest, 

A wealth of information about home^based program 
operations also is contained in two Office of Child 
rwelopment publications; A Guide for Planning and 
Operating Home-"Based Child Development Programs / TdHEW 
Publication No. COHD) 75-1080], June 1974# with versions 
available in Spanish and English; and A Bibliography^ of 
Home*Based Child Development Resources [PHEW Publication 
No, HEW-391], March 1973, Copies may be obtained free of 
charge by writing Home Start, Office of Child Development, 
P,0, Box 1182, Washington, D,C, 20013, 
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HOME STAiW EVALUATION REPORTS 



• Interim Report I (August 1972} 

Formative and Sununative Evaluation (ED 069 439) 
Case Studies lA (ED 069 440} 
Case Studies IB (ED 069 441) 



• Interim Reports II * Pilot Year (July 1973) 

Program Analysis (ED 091 074) 
Summative Evaluation Results (ED 085 398) 
Case Studies IXA (EO 091 081) 
Case Studies IIB (EO 092 225) 

• Interim Report III - Pilot Year (August 1973) 

Evaluation Plan 1973-1974 (ED 092 227) 
Program Analysis (ED 092 226) 
Summative Evaluation Results (ED 092 229) 
Case Study Summaries (ED 092 228) 

• Interim Report IV * Pre-Tesfc (May 1974) 

Program Analysis (ED 107 379) 
Siimmative Evaluation Results (ED 107 360) 



• Interim Report V - 7-Month Findings (Nov9m)Der 1974)* 

Executive Summary 
Program Analys/s 
Summative Evaluation Results 
Cost Effectiveness Analysis 
Field Procedures :4anual 

• Interim R^rt VI - :\2-Month Findings (March 1975)* 

Executive Summary 

Program Analysis^ Summative and Cost Effectiveness 

Results 
Field Procedures Manual 

• Interim Report VII * 20*Month Findings (November 1975)* 

Twenty-Month Program Analysis and Findings 
Homesbook: What Horae-Based Programs Can Do For 

Children and Familif^s 
Field Procedures Manual 

• Home Start Information System Manual (December 1972)* 



* Volumes not yet in the ERIC system. 




Field Procedures Manual* 
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CASE STUDIES * Pour sets of case studies on individual 
Home Start projects wer^' prepared during the course of the 
three-year evaluation. Interim Report I Case Studies {Volumes, 
la and b) documented start-^up operations, such as proji^ct organi- 
zation, policy making, staff recruitment. and. training^ an<t;eawily^ 
enrollment. Identified were project goals and objectives for the 
four seinrice components (health, education, nutrition and psycho* 
logical/social seinrices). Discussions also focused on the re- 
lationship projects had with Head Start as well as resources 
shared, A two*page summaory of each case studv was included in 
Interim Report I (pp, 25-61) • A brief description of the pro- 
jects also was presented in Chapter I to the Hoinesbook (pp, 1/19- 
24) • The sMccess and/or problems projects had in achieving pre- 
liminary goals and objectives were discussed in Interim Report 
II Case Studies * Project goals were compared with actual ser- 
vices provided to families. Family needs identified through 
a needs assessment procedure were examined, resulting in the 
development of a set of refined goals and objectives* The third 
set of Case Studies ( Interim Report m ) summarized the first 
two, with a brief update regarding changes in project organization 
staffing and seinrice delivery, and a discussion of problems pro- 
jects encountered in starting up their operations. To portray 
some o£ the accomplishments of the Home start projects. Case 
Studies in Interim Report V highlighted an authentic family 
success story for each project* Also discussed were problems 
the projects dealt with or continued to deal with in their com- 
munities and changes in staff composition, project organization 
and service delivery since the previous set of case studies was 
prepared* 

Each case study contained an "In Brief" section providing 
factual information regarding the Home Start projects. The "In 
Briefs" listed the project sponsor, staff positions, start*up 
date and operating hours* Also included was some basic demo- 
graphic information such as number of families and children 
enrolled, employment and family income, age of the focal parent, 
and the ethnic match between focal children and staff* Budget 
information ::as presented showing both federal and total costs 
(including levered goods and services}* 

COST EFFECTIVENESS , The Cost-Effectiveness Volume of 
Interim Report V (pp, 24-46} examined several aspects of Home 
Start project operations to define areas in which efficiency 
could be increased and to make specific policy recommendations* 
The content of home visits was evaluated to determine ways the 
home visit process could be improved. Extensive analyses also 
were performed to find a set of home visitor characteristics 
(both in terms of personality traits anci years of schooling) 
which were statistically related to test performance of focal 
families (pp* 31-32) . Interim Report VI (pp* 85-99) identified 
five general characteristics of Home Start which are major de- 
terminants of cost: (1) duration and intensity of service de- 
liveryr (2) credentials scught of home visitors; (3) number and 
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type of support staff; (4) supplementary goods and s^inrices 
provided to families; and (5) target sites for ftmiding of 
locaZ projects* Although cost implications of variations in 
the duration and intensity of seinrice delivery were, examined, 
no data were presented regarding the effects on famiilies* 
These were reported in Interim Repbrt VII (pp, 10^*i09) * Also 
reported were determinants of variations in program searvices. 

The methodology used for determining the relative costs , 
and benefits of the Head Start and^Home Start programjtt (constant 
cost analysis) vfas discussed in Interim Report V ( Cost ^Ef f ective* \ 
ness Volume , pp, 47-50) • Information was presented^ regarding unit 
costs as well as (summative) outcomes for the twp programs after 
seven months* Also briefly discussed were basic differences 
between the two programs to be taken into consideration when - 
examining the relative cost-effectiveness of Head . Start and Home 
Start, Interim Report VI (pp, 100*»105) compared'"HaaiS Start and ^ 
Home Start coats and benefits after one year, Siidlar data vere 
presented in Interim Report VI I (pp, 104-105) 19 months after 
pre-test data were obtained, 

COSTS OF HOME START , Interim Report II (pp, 25-2S) exam- 
ined Home Start budgets as thov were suunitted with first-year 
proposals. Some preliminairy rec<xmnendations were made regard* 
ing the allocation of funds* Projected expenditures were re* 
examined in Interim Report III (pp, 38*64) by budget line item 
as well as by functional categoiry, Onit costs per family were 
determined on the basis of these projections and were adjusted 
to reflect regional variations in the cost of living. Cost data 
presented in Interim Report IV (pp, 49-68) were for the six sum* 
mative projects only. The report again examined allocation of 
OCD and levered resources costs by functional category to deter- 
mine per-family unit costs. The Cost'^Ef f ectiveness Volume of 
Interim Report V (pp. 2*23) reported cost and expenditure pat* 
terns of the sixteen projects and examined site to site varia* 
tions, based on eight-^month cost data. Projections were included 
regarding yearly costs. Model budgets were presented for an 
average urban and rural area in the.U,S, with three different 
levels of family enrollment. Model budgets, together with cost 
of living indices, can be used to adjust costs to reflect the 
cost of living in different locations in the countiry. Also 
addressed was the intra^program efficiency of projects # as well 
as a number of other cost-effectiveness issues (see COST EFFECTIVE 
NESS ) . Cost data reported in Interim Report VI (pp, 45-51) cov- 
ered OCD and levered resource expenditures of the six summative 
projects for a full year. Similar data were presented for all 
sixteen Home Start projects in Interim Report VII (pp, 29-34) , 
Home Start c^ ^cs and cost issues to be consiuered in converting 
from a center- to a home-based operation also were addressed in 
the Home shook (pp, 6/24-47) . 

For a comparison of Home Start and Head Start costs see 
HEAD START COSTS AND BENEFITS, 




DATA COLLECTION PROCEDURES * FORMATIVE . Interim Report I 
(pp. 81*82) briefly discussed procedures followed In obtaining 
data during spring 1972 site visits and outliile^^ plans for data 
collection in the fall. Instruments used for spring 1973 site 
visits were included in Appendix A of the Program Jtoalyacxs Vol" 
uroe of Interim Report III as well as a description of general 
field procedures. The purpose of spring 1974 site visits was 
discussed in the Program Analysis Volume of Interim Report V 
(pp. 7-11) . Also included was a brief description of instru* 
ments used^ training of staffs data reduction and analysis. 
In the Appendix of the same volume problems with instruments and 
data quality- were discussed. Similar discussions of formative 
evaluation methodology were included in Interim Report VI 
(pp. 124-130) and Interim Report VII (pp. 137-142). 

DATA COLLECTION PROCEDURES ^ SUMMATIVE * Manuals out* 
lining in detail procedures to be followed in obtaining data 
frcm control r Home St?j:t and Head Start families ware prepared 
for each data collection period starting in the fall of 1972. 
Manuals described the organization and responsibilities of on- 
site staff r site preparation activities to be conducted prior 
to data collection r monitoring and logistics* Also included was 
a section outlining problCTis which might be encountered in ob- 
taining data and suggestions for handling those situations. A 
brief discussion of data collection procedures and problems 
during each data collection period (including such issues as 
recruitment of community interviewers^ sample attrition^ train- 
ing procedures and data quality) were included in the Summative 
Evaluation Volumes of Interim Reports II through VII . Discus- 
sions can be found starting on p. 9 of Interxm Report II f* p. 8 
of Illf* p* 18 of IV,* p. 16 of V,* p. 167 of VI, and P* 187 
of VII . 

DATA QUALITY - HOME VISIT OBSERVATIONS . Inter-observer 
reliability on the Home Visit Observation Instrument was reported 
in Interim Report V ( Program Analysis Volume , Appendix B, p. 105) 
and VI (pp. 131-139). Appendix A of Interim Report V also dis- 
cussed problems that were encountered in collecting other pro- 
grammatic data in the spring of 1974 

DATA Quality - summative . interim Report II ( Suimnative 
Evaluation Volume , pp. 9-24) discussed rxve xssues concerning 
the quality of summative data collected during the pilot year: 
fidelity of the randomized family lists, incidence of missing 
data, conditions of testing in the home, battery administration 
time, and data collection start and finish times. Similar 
aspects of pilot year data were included in Interim Report III 
( Summative Evaluation Volume , pp. 8-16). Inter-judge reliability 
in scoring parent and child responses and average number of 



In Summative Evaluation Volumes. 
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errors made in the ''administration" of the measurement battery 
also were presented in this repqrt (pp* 217-220)* Interim Re* ' 
port IV ( Sviinmative Evaluation Volume , pp, 18-39) addressed fi- 
delity to random sample lists for the control, Home St€u:t and 
Head Start groups of families at the time of the pre-test, as 
well as other aspects of data quality* The two subsequent re- 
ports reviewed similar data quality issues and discussed sample 
attrition and attrition effects ( Interim Report V , Summative 
Evaluation Volume , pp* 16-28 and Interim Report VI , pp/l68* 
207), A two-year profile of inte^-judge reliability on the 
Preschool Inventory (PSI) and the Denver Developmental Screen- 
ing Test (DDST) was presented in Interim Report VII (pp* 194" 
196), Also included was an oveanriew of total sampTe attrition 
over the two years and a profile showing average number of 
errors made in the admin is trai:ion of the summative measurement 
battery since the fall of 1973* 

DEMOGRAPHIC INFORMATION . Some basic facts about projects, 
families and staff were included in each of the seven Interim 
Reports based primarily on Home Start Information System re* 
ports which projects completed quarterly* Specific aspects of 
project operations and organization that were reported on in 
more detail included discussions on: 

- Family! Enrollment , to determine how enrollment affected 
per-family cost ( Cost-Eff6Qt:iveness Volume of Interim 
Report V , pp, 37-'46 and VI^ p* 93) . 

- Home Visitor and Parent Age and Education ^ to determine 
the degree of match on a project-by-project ( interim 
Report IV , pp, 19-21) and a family level ( Program Analy- 
sis Volume of Interim Report v ^ pp, 21*22), 

- Project Stability , examining turnover of staff and fami- 
lies ( Interim Report IV^ pp* 10-11, the Program Analysis 
Volume of V, p, 17, and VII , pp* 38-40)* Tables pre- 
sented in the last volume "tocused primarily on family 
turnover and the length of time families remained in 

the program* 

- Staff and Child Ethnicity , to determine whether projects 
were sensitive to the cultural needs of families* In - 
terim Report II (p, 22) examined the ethnic background 
of staff and focal children and showed the degree of 
match for the Home Start program. Similar data on a 
project-by-project basis were reported in Interim Re *^ 
port IV {pp* 14--18) , while the Program Analysis Volume 
of Interim Report V (pp* 22-27) showed ethnic match for 
the entire program, individual projects, as well as on 

a family level* 

One-tO'-one match data (at a family level) were presented 
for the six summative projects only* 
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GENERRLI2ABILITY OF FINDINGS . Interim Report XVg ,<pp, 76* 
79) examined the extent to which findings frc^jbhe sij^^ 
projects reflect the entire Home Start' program ~in suciiVaiSe as 
home visit characteristics and allocation of fun^Ss;, rSeyeral 
figures and tables included in the Interim Repoi?ta irtj^ totals 
for the six summative as well as for tne ten non^suwMti^ 
jects although differences between the two sets of prefects were 
not discussed in detail. Specific comparisons were made in the 
areas of: , . ^ ^ ^ 



- Cost 



Interim Report IV j p, 7^ 
Interim Report VII , p^, 34 



Demographic 
Characteristics 



Interim Report pp, 74*75 



- Ethnic Match 



Interim Report IV , p, 16^ 
Interim Report pp. 24, 26, 79, 
80, 81 



Family 
Enrollment 



Home Visitory 
Family Ratio 



Interim Repoj^t V , p, 16 
Interim Report VI , p, 107 
Interim Report VII , p, 115 

Interim Report VI ^ p, 108 



- Home Visits 



Interim Report IV , pp, 76, 78 



- Referrals 



- Time Use 



Directors 
Specialists 



Interim Report V , pp, 67, 68, 70 
Interim Report VII , p, 121 



Interim Report V , pp* 82, 84 
Interim Report V , pp. 35, 37, 39, 
d^, 84 



Interim Report VI (pp* 52-55) addressed some issues rela- 
ting to the generalizability of findings and discussed the ex- 
tent to which future home-based projects can expect to replicate 
the achievements of the Home Start demonstration program* 

GOALS AND OBJECTIVES . Interim Report I (pp. 9-24) examined 
in detail preliminary goals and objectives of local projects as 
well as those of the National Office to determine ccmpatibility. 
Preliminary objectives were reported for families and children 
in each of the four program component areas (health, nutrition, 
education and psychological/social services). Discussions about 
local project goals and objectives also were included in indi- 
vidual case studies (Volumes la and b of this first report) . The 
relationship of program goals to the measurement battery also was 
discussed (pp. 85-93) . Interim Report II (pp. 5-13) re-^examined 
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national objectives and the way local projects organized them- 
selves to meet these objectives* Local objectives for specific 
components of the program were reviewed to determine their re* 
lationship to project structure and to seinrices provided to 
families* A refined set of objectives and goals based on needs 
assessments of families was included in the report* Aids and 
deterrents to meeting f^rst-year objectives were discussed in 
Interim Report III (pp* 67-70) ^ as well as the extent to which 
goals and objectives were achieved* Chapter II of the Homesbook 
(pp* 2/18-28 and 4/2-9) discussed family needs assessment pro- 
cedures as a preliminary step in setting individual goals and 
objectives for children and their families* 

HEAD START COSTS AND BENEFITS * The Cost"Ef fectiVeness 
Volume of Interim Report V tpp* 47^50) compared the unit costs 
of Home Start and Head Start based on 8-^onfch cost data* Also 
discussed were the relative benefits fo^ Home Start and Head 
Start families after having been involved in the program for 
seven months r as well as program differences to be taken into 
consideration in con^aring program costs and benefits* Heme 
Start and. Head Start outccsnes are discussed in more detail in 
the Summative Evaluation Volume of this report (pp» 133-135) 
and the Interim Report V Executive Summary (pp* 12-13 and 18-20)* 
Similar discussions were included in Interim Report VI XPP* 101- 
105) based on data obtained twelve months after Home Start and 
Head Start children entered the program* A more detailed dis* 
cussion of 12-month outcomes for Home Start and Head Start 
children was included on pp* 70-71 and 76-77 of the same volume* 
These findings were summarized in Interim Report VI Executive 
Summary tpp* 15-18)* Interyi Report VII ccxnpares two years of 
Home Start with two years of Heaa Start in terms of benefits 
(p* 91) and the cost-effectiveness of the two programs (pp* 104- 
105)* 

HOME VISIT * Interim Report III (pp* 6-37) discusses an 
ideal home visit, as well as qualities, training and character- 
istics the ideal home visitor should have according to project 
directors and supervisory staff. Ideal profiles were compared 
to the actual home visit arA home visitor characteristics* Home 
visit data were obtained through obsearvations in the home of 
interactions between the home visitor and family^ home visit 
content, utilization of materials and communication style and 
tone. Interim Report IV (pp* 22-42) again presented data re- 
garding the home visit activities. Also included in this re- 
port were discussions by home visitors on how they transfer 
skills to parents and how they know they have been successful* 
Examined were theories of modeling behavior to determine to what 
extent modeling occurred during the home visit* Home visit data 
included in Interim Reports III and IV were based on , frequency 
analysis. More complex analysis tecHniques were used for sub- 
sequent reports which documented the amount of time spent on 
various interaction patterns* 
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The most comprehensive view of the home visit was presented 
in Interim Regort V ( Program Axialysis Voluiae f pp* 45*^64) * In* 
eluded were home visit profiles for the typical project/ as well 
as discussions regarding across and within site variations in 
home visit characteristics* Home visit data (obtained through 
observations) were compared with home visitor reports of the 
content areas covered during the visit* Also discussed was the 
extent to which home visitors encouraged parents to work with 
the child between home visits and the amount of follow-up home 
visitors did with families. Reasons home visitors chose spe* 
cific activities for their home visits were reported* Less ex- 
tensive analyses of home visit observation data were conducted 
for Interim Reports VI and VII* Interim Report VI (pp, 28-31) 
reported on discussions with project staffs regarding the home 
visit profile to determine how accurately the observations 
captured what went on in the home* Some measurement problems 
were identified in the Report, Also discussed were changes in 
home visit characteristics from spring to fall, as well as 
changes in the obseinration instrument and how they affected 
comparisons. Interim Report VII (p* 20) presented a two-year 
profile of how^ visit eri^hasis Tcontent and interactions) to 
determine how i changed over that period. Anecdotal informa- 
tion on home visits was included in the Case Study Volume of 
Interim Report V and.the . Homesbook * 

Interim Report V ( Cost Effectiveness Volume , pp, 24-33) 
discussed the content of home visits and evaluated the poten- 
tial for improving the effectiveness of the home visit process* 
Multiple regression analyses were used to determine the relation- 
ship between the amount of time spent on specific home visit 
content and child or parent outcomes (as measured by the suimna- 
tive measurement instruments)* Subsequent multiple regression 
analyses (reported in Interim Report VI ^ pp, 37"38) examined 
how home visitor background and the amount of time the home 
visitor had worked with families affected home visit character- 
istics (emphasis on either parent or child, content, as well as 
total visit length) . 

The frequency of home visits, the nximber of families not 
visited weekly, reasons for missed visits, and the total sunount 
of time home visitors spent per week in home visits were re- 
ported in Interim Report V ( Program Analysis Volume ^ p* 42) and 
VII (pp* 12-16), based on home visiting records for summative 
families. Also reported in Interim Report VI (pp, 11-13) were 
changes parents would like to see in home visit frequency and 
duration and how these changes would affect per-family cost* 
Interim Report VII (pp>> 108-109) also examined the relationship 
betweon home visitor and/or family characteristics and home visit 
frequency and duration. 

Inter-observer reliability on the Home Visit Observation 
Instrument was reported in Interir' Report V ( Program Analysis 
Volume , Appendix A, p* 105) and. VI (pp* 131-l5?n A copy of 
the observation instrument was included starting on p, 140, 
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HOMg yi&iyOR > Interim Hepott^ XII^. i^py/lt^ 'f . 

the i3eiriioSi~yrei4:'ini3Bo5iv^ ■ 
iO»ut,home'\idtelltofr^experience/a^ Jl^t'^^p^ 
phasis. Also' ex42(iln6d was ^je conalstttj*^| of 
with' horn?: visitor, exi^rienc^. an*/l%^c^:^g;^r,4P4■^V'^%^^ 
presented jce^g^arding the educatjitdmil'rfeacXg^M 
perience with children, or ^a4ults.ai[wS,^*tei,¥lw 
visitors. A mox^ detail^ prof iie S^-^^ffl^ 
inf oraiation was Inc.iuaed in to^rini IfeSS^ 
Volime ^ p. X5}, lncxu4ii»g X^p!v^iSoir^^!5^i&;^ 
project, nunOjer of families serir^, ^^r|p^»^ 
and level of education. mi^Xplj^-^^MmdrnM 




niques, were used for Interim^ 
Volume ^ pp. 31-32) to^^HetScSE^a ) 
Titles (personality and years o| 
lated to t^a^d;.,p<er|A¥5B^^ 
(pp. 37*38), using siinilar teclmX^j^ 
home visitor background and ^he^aj^f " 
had worked with the family on haine ^ ^ 

(emphasis on parent or phlld and coriterif)lf^^ 
visit length. Also examine in thisv^^p;^ 
tions of variations in tbe^ nuokber of . ^an£li^^^ 
visitor and credentials sought by proje6tsf_ in ^M 
Similar analyses were conducted for InteripBt ItjeTOXt- VII to ideh 
tify home visitor characteristics that affected visit length 
and duration (pp. 100*^109) . 

For a discussion of age, ethnicity and education match 
of home visitors and the families they served, see DBMOGRftPHIC 
INFORMftTION . 

The amount of time home visitors spent in the home, on 
family support services (home visit preparation, referrals, 
parent meetings and providing transportation for families) , 
training, other activities and travel, to and. frosi^ families 
were reported in the Program Analysis Volume of Interim 
Report V (pp. 38-43) . Also examined was the relationship 
between the amount of time home visitors spent with families 
in the home and time spent on training activities. 

The role of home visitors and their varied duties were . 
described in the Homesbook (pp. 1/10-11). Chapter IV of the 
book (pp. 4/15-18) discussed the relationship of the home 
visitor and the families she worked with. 




HOMESBOOKt WHAT HOME-'BASED PRCK3RAMS CAN DO FOIt CHILDREN 
AND FAMILIES . Developed in lieu of a fourth set of case studies 
on the sixteen Home Start projects, the Homesbook compiles the 
experiences of project staffs who operated home-based programs 
over the past three years. It is based on interviews with 
project staff, as well as on previous case study volumes (see 
CASE STUDIE S) . Written in an informal style, the book is 
addressed primarily to individuals either affiliated with Head 
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start or other child care progr€U3(tSf or who have at least some 
wrking knowledge of ^hild care prograaas in general; The book 
is not intended strictly as a "how to" guide; rather^ it de- 
tails the experiences of Home Start staff in dealing with issues 
and problems which are important for home-based early childhood 
development* 

The Homesbook is organized into six chapters; a brief 
description of topics addressed in each chapter follows: 

!• Home Start in Action 

This chapter presents a brief background history of Home 
Start as a demonstration progr€U3(t and discusses its re- 
lationship to Head Start, the Office of Child Development, 
and the families it served. Some general findings from 
the d^onstration program are discussed. Three family 
"success stories" are presented as well. 



II, Getting Underway 

This chapter addresses basic issues involved in starting 
a home^based program. Planning includes finding and hir* 
ing staff; recruiting families; and arranging for services 
(social, health, educational) and resources (meeting and 
office space^ transportation) which are essential to home* 
based programs* 



III, A Basic Program 

Education in the home is the first issue discussed in this 
chapter, including its staf,?ing, development of curricula, 
use of materials, and working with parents as teachers of 
their children* Sample materials and curricula are in* 
eluded* Health and nutrition components are addressed as 
well, including staff, kinds and sources of services pro- 
vided, and different approaches to providing health and 
nutrition education to parents and children* 



IV, Working with Families 

This chapter deals with the issue of working with families 
as a whole — focal children, older siblings, parents, grand- 
parents; of helping to meet varied needs while encouraging 
families to be independent* Provision of community services 
is explored in terms of problems (employment and training, 
benefits, counseling, etc.) and roles of social service 
staff responsible for these services* Parent involvement-" 
through parent groups and policy councils— is discussed, 
along with children's groups, as part of the "social Home 
Start*" A discussion of Home Start's function as an advo- 
cate for its families' service needs concludes the cha^^ter* 



V, Management issues 

A number of basic issues relating to the' pp$ratioh>,o^ a 
home-1>ased program are addressed in this chapter;. Pre* 
and in*service training for staff are. discus^^eiil^^^^ . 
detailed descriptions of f our progr^uxust h^^ 
service training* Sasq^le training Wchi^lileB 
The last section of the Chapter adSresses. loi^^rJi^ 
planning issues as weXl as vays projects ef\ralU9t^ > 
gress with families and their overall operations. / ; \ 



VI, Planning issues for Homg - ' qased Programs ' . /^y 

I'he chapter is devoted to major ..iasues to be" dprisj^^jl^^^^ ■ 
in planning a new home*based program pr convert^liig|^4V; 
Start Center program to include ,ndm<^ "^slting^r pl^C.^^ 
are setting program goala.and iMal' daaiaw^ 
based program; program organization and familleai^^^ 
served; resources needed to start a program^ Such as / 
space, staff, transportation; conversion of Head Start; 
and costs and financial management* ^ 

INFOBMATION SYSTEM , To obtain basic Statistical informa- 
tion regarding f amiliis, staff, referrals and financial expeh* 
ditures from local projects, a Home Start Information System 
was prepared in 1972 under a separate contract from OCD* The 
Home Start information System Manual (December 1972) contained 
detailed reporting procedures for local projects and for com* 
piling a national profile by quarter and year, as well as 
combining data from all sixteen projects for the entire demon** 
stration period* Demographic information included in each of 
the Interim Reports was based on Information SysteaR data* The 
development of the Information System was discussed in Interim 
Report I (pp* 74-75), 

LITERATURE REVIEW * A review of research literature on 
home-based child development programs was presented in pre- 
liminary form in Interim Report VI (Appendix I) , This review 
was updated for Interim Report V II and was included as Appendix 
E, Abstracts of 35 research reports were included, along with 
a critique of studies and a synthesis of the findings* 

MEASUREMENT BATTERY . Guidelines and criteria for the * 
selection of measures were presented in Interim Report I (pp. 
86-90) together with recommendations for the measurement battery 
to be usu^ during the pilot year of the evaluation* The pro- 
posed measures were discussed in detail in this report (pp. 90* 
106). Interim Report II identified a number of problems with 
the measures and recommended changes in the battery (pp. 150-155) 
Based on pilot«*year data, the strengths and weaknesses of the 
measures were re-examined resulting in further battery refine- 
ments for conducting the 1973-1975 summative evaluation 

( Interim Report III , p. 87). In-depth discussions about each 
of the measures were included in each of the seven reports 

(see PSYCHOMETRIC ANALYSES ^ . 

72 DO 



NATIONAL HOME START OFFICE . Interim Report I (p. 83) pre- 
sent e5""a""sHorFTrofTI^~oFTEeTri St ory^ birthr 
early, planning and selection of projects. Also examined was 
the relationship between the Home Start and Head Start program., 
and the future of Home Start as an alterm Mve to Read Start 
rather than a separate program* A history of Home Start also 
was included in the Homesbook (pp« 1/3*6) « In the appendix to 
Interim Report I a nmnber of documents were included whicn re*- 
late to Home Starts such as a copy of the Home Start Guidelines* 
The national case study included in the Oa^e Study Volumes of 
Interim Report II described the resporsibilities of the four 
full-time staff members of the Natioi^al Office and discussed 
activities performed over six months r such as visiting local 
Home Start projects^ planning and information dissemination* 
Also addressed were resources the National Office used# as well 
as roles and responsibilities of the regional offices ^nd the 
local Home Start projects. The national caee study concluded 
with a disC;Xiision of the future of Home Start* Interijn Report 
VI (pp, 52-55) ^.ddressed the issue of replicability of Home Start 
demonstration program achievements fay other projects that do 
not have strong National Office support* Discussions about the 
kinds of support services the National Office extendedr how they 
were valued fay local projects r etnd suggestions for improvements 
were included in Interim Report VII (pp* 51-63) * The impact of 
National Office guidance was examined in two areas of program 
operations— home vi3itor supervision and nutrition for Interim 
Report VII (pp* 64- "^T) • 

PARENT EXPECTATIONS . Shortly after joining Home Starts 
parents were aska;^ by their home visitors what they expected 
from their involvement in the program* Parent comments were 
reported in Interim Report Il r Program Analysis Volume (pp* 40- 
42) and in Appendix C of the Sumraative Evaluation Volume * 
Expectations for themselves and their preschool children were 
described in relation to the start--up nature of the projects* 

PARENT INVOLVELi£NT * Three types of parent involvement < i 
the frequency of parent activities were discussed in Interim 
Report II 'pp* 28-29;: parent policy councils^ group meetings 
and social a ^tivities* Educational objectives of local pro- 
jects were examined to det$rmi.^3 whether parents or children 
were to receive primary attention from home visitors (p* 34) * 
(See HOME VIS 11 for more in-depth discussions about parent 
involvemf ' ^ :he home visit*) Interim Report VI (pp* 42-44) 
presentee j preliminary findings regarding family participa- 
tion in c and parent group meetings^ parent policy council 
meetings^ ef home visits^ trips to the doctor or other social 
service providers r and other activities* A more comprehensive 
overview of family participation in these types of activities 
was presented in Interim Report VII (pp* 21-27) r as well as a 
more detailed discussion about thebe activities* The Homesbook 
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(PP- 4/1-$) discussed program emphasis on the total family 
rather than only on the focal childr and how projects Involved 
other family members in program activities (such as fathers^ 
siblings^ etc.) and helped to meet their needs. Family in- 
volvement in parent and children's groups and policy making 
also were addressed in the book (pp. 4/25-37). 

PHOGRAM COMPONENTS . Interim Report II (pp. 31-39) dis- 
cus sed^iocaT^^Jectlves for each of the program components 
(healthr education^ nui:rition and psychological/social services) r 
how each of the components was staffed r component activities 
conducted in the home^ as well as referrals in each of the ^ 
service areas. The nutrition c<»nponent was studied in depth 
tor Interim Report VI (pp. 20-26) because of a lack of sig- 
uificant summative findings in this area. Data reported in 
this report included the amount of staff time that^ was spent 
on nutrition (planning^ training^ consultation with home visi- 
tors r And on providing direct services to fauailies in the home 
or at parent meetings) in the six suiomative projects. Also 
reported was the amount of time that was spent in staff meet-* 
ings and providing 3.ndividual help to home visitors (both in 
pre- and in-service training) r time spent on nutrition in home 
visits as w*.tl as the type of topics covered; the relative 
emphasis that was placed on daily nutritional needs r food 
groupsr menu planning^ shopping^ cooking^ food storage! nu- 
trition assessments; and provision of vitamin supplements. 
Interim Report Vll examined changes in the nutrition components 
of the 16 projects which were made in response to nutrition 
findings reported in the fall of 1974. Also reported were 
staffing patterns in the 16 Home Start projects for the four 
program components (pp« 11*12). Chapter ill of the Home shook 
extensively discussed various aspects of the education Cpp* 3/1- 
49) r the health (pp. 3/62-77) and the nutrition components 
(3/50-80) f including staffing^ curriculum and materials* The 
social service component of the progr2ua was addressed in 
Chapter IV of the book (pp. 4/9-24), 

PROGRAM EFFECTIVENESS AND EFFICIENCY see COST EFFECTIVENESS , 

PSYCHOMETRIC ANALYSES . The internal characteristics of 
each measux : were examined at each testing time. These analyses 
included response distributions^ item intercorrelations r factor 
analyses and internal consistency reliabilities. The analyses 
for the fall 1973 pilot testing were reported in interim 
Report II * (pp. 25-120) and for the spring 1973 testing in 
Interim Report III * (pp. 19-70). Psychometric analyses of fall 
1973 testing were reported in interim Report IV* (pp* 40-100) r 
spring 1974 testing in interim Report V * (pp. 29-107) r fall 1974 
testing in interim Report VI (Appeno[Ix"E) r and spring 1975 
testing in interim Report Vll {Appendix D) , 

*ln Summative Evaluation volume. 
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REFERRALS . Interim Report II (pp, 37-39) briefly ex* 
amined the number and types of referrals that were made and 
the actxial seinrices families received. Staffing patterns 
of local projects were reviewed to determine whether staff 
had been designated to coordinate referral activities with 
conimunity agencies. Interim Report III (pp. 58*64) again 
presented referral data not only^by type but also by recip* 
lent of referral service and discussed the success projects 
had in completing referrals. The role of referrals and the 
utilization of levered resources were examined in detail. 
In addition to reporting the number of referrals made and 
received^ Interim Report IV (pp. 42-48) discussed how much 
time staff spent making referrals^ as well as variations 
across projects in the number and types of referrals made. 
Similar information on referrals was included in I nterim 
Report V (pp, 65-70), Interim Report VI (pp, 14-X9) ron the 
other handr examined eligibility of summative families for 
food stamps and Medicaid and family usage of these two pro^ 
grams. Also discussed were reasons not all eliQ'.ble families 
were availing themselves cf these serviceSf as well as the 
role of home visitors In changing basic family attitudes 
about community resource usage, A list of agencies to which 
referrals were made was included in the Homesbook (pp, 6/14- 

15) , 

' SAMPLE ATTRITION , Attrition of families from the sample 
between fall 1973 and each subsequent testing was analyzed 
and reported in Interim Report V* (p, 32) r Interim Report V I 
(pp. 169-170) and Interim Report VII {Appendix C) , 

SERVICE DELIVERY MECHi\NISMS , Interim Report II (pp- 13- 

16) examined initial planning documents r proposals and guide- 
lines to identify basic features of the program and to develop 
a model showing service delivery mechanisms. Staffing patterns 
of local projects were compared against the model to determine 
whether they were consistent with the intent of the program. 
The role of the home visitor and the diverse nature of home 
visitor responsibilities were discussed in detail. The length 
of the Home Start program year was examined in Interim Report VI 
(pp, 7-9) to determine whether it followed the school year or 
permitted families to be involved for a full year. Discussions 
also focused on the number of weeks during the year home visits 
did not take place because o6 special training activities^ 
vacations^ holiday celebrations^ etc. The length of time 
families were served by local projects was reported in Interim 
Report VII (pp, 38-40; r as well as variations in the duration 
and intensity of service delivery both across and within pro- 
jects (pp, 41-42), The effects of variations in the duration 

of home visits on parent and child outcomes were examined in 



"^In Summative Evaluation volume* 
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the Cost-Effectiveness Volume of Interim Report V (pp. 32"33). 
Similar analyses were performed for Interim Report VII (pp. 107-- 
108). The impact of other variations in the intensity and 
duration of service delivery on family development (7 months 
of service compared with one year and one year compared with 
two years of program involvement) was examined in Interim 
Report VII (pp. 106-107). 

For a discussion of other aspects of service delivery see 
HO ME VISIT ^ PARENT PARTICIPATION and REPERRM*S. 

STAFF TRAINING . Interim Report II (pp. 30'*31) described 
various aspects of staff training—frequency/ foirmat/ affilia- 
tion with Head Start/ the use of r ^nsultants and academic 
institutions / and content areas covered. Training needs of 
home visitors, methods of delivering training BerviceSf and 
content were discussed in Interim Report ill (pp. 11-19). Also 
examined was the role of pre-seanrice training in home visitor 
skill development and the types of training home visitors 
received in pre- and in-service training , as well as perceived 
effectiveness. Interim Report V ( Program Analysis Volume / 
pp. 30-43) reported on the amount of time home visitors/ di** 
rectors and specialists spent on training. The amount of time 
spent in pre* and in-searvice training for the nutrition com- 
ponent was reported in both Interim Reports VI (pp. 21-23) 
and VII (p. 72). Interim Report VI (p. 91) discussed the 



examined its effect on time spent with families in home visits 
or the provision of direct services to families. Pre-service 
and in-service training were discussed extensively in the 
Homesbook (pp. 5/36-63). 

START-UP OF PROGRAM OPERATIONS * Interim Report II (pp. 19- 
20) discussed recruitment of families by local Home Start pro*- 
jects and the types of families that joined the program. Con-* 
cern was raised about recruiting methods as well as the age of 
focal parents who entered the program. Problems projects en- 
countered during the first nine months as they were starting 
up were addressc^d (pp. 48-56), such as (1) staff and family 
turnover, chan':;<ss in program activities and locating office 
space; (2) sta.:f morale and support services required by home 
visitors (especially in the area of training); and (3) demands 
by outsiders for information. Some recommendations were made 
for addressing problems which were not solely of a start-up 
nature but part of the ongoing process of project operations. 
Interim Report III (pp, 65-70) summarized aids and deterrents 
which were experienced by a large number of project directors 
in meeting first-year local oblect-iveSp Chapters II and IV 
of the Homesbook addressed a wide range of planning and start-* 
up issues to be 'considered by Head Start projects adopting the 
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home-based I & I option or other child development programs 
establishing a Home Start^type operation* Issues discussed 
include determining the demand for home-based searvicesr set- 
ting goals and identifying resources required* Also included 
were discussions about recruiting staff and families r pre- 
service training, arranging for services and resources* Costs 
of operating home-based programs \^ere addressed in Chapter VI 
of the book* 

SUMMRTIVE EVALUATION DESIGN * The design of the summative 
phase of the evaluation was briefly described in Interim Report I 
(pp* 85-86)* The suranative volume of each interim report brief- 
ly descril>es the design, and the most complete description caii 
l>e found in Appendix B of the Final Report * 

SUMMATIVE FINDINGS * Although program outcomes were not 
analyzed until later. Interim Report II / Summative Evaluation 
Volume descril>ed entering performance levels of Home Start 
children in the pilot phase of the evaluation (pp* 121-149; 
152); the Program Analysis Volume (pp* viii-ix; 41-47) 
summarized these findings and discussed child and family 
characteristics in terms of entering family needs* 

Preliminary findings were estimated from the first (pilot) 
year of the evaluation, 1972*^73, for four of the child tests 
and rating scales, using growth curves estimated from the fall 
1972 scores (there was no control or Head Start group at that 
time) — Interim Report III , Summative Evaluation Volume 
(pp, 77^837^ 

Entering characteristics of children and families partici- 
pating in the true evaluation were described in Interim Report 
IV, Summative Evaluation Volume (pp* 101-116)* 

The outcomes from the first seven months of the true 
evaluation (fall '1973 to spring 1974) were presented in 
Interim Report V . The Summative Evaluation Volume (Chapter VI) 
described the comparisons of the Home Start and control groups, 
organized by child outcomes {school readiness, social-emotional 
development, physical development, nutrition and medical care) 
and mother outcomes (mother-child relationship, mother as 
teacher, home materials for the child, and use of community 
resources)* The comparisons of Home Start and Head Start on 
the same variables were also included in Chapter VI* The 
Executive Summary summarized these findings (pp* 9-20), re- 
lated them to program costs and suggested ways of making Home 
Start more cost/ef f ective* 
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Twelve-month* findings (fall 1973 to fall 1974) were re- 
ported in Interim Report VI , Part B (pp. 56-82). Both Home 
Start-control (pp. 64-67) and Home Start-Head Start (pp. 76- 
77) findings were presented and discussed. The Executive 
Summary summarized the impact of Home Start during the first 
12 months (pp. 12-15) and related these findings to the 7- 
month outcomes. The 12-iaonth costs and effects were also 
compared with corresponding costs and effects of Head Start 
(pp. 15-18). Interim Report VI also attempted to explore 
possible relationships between entering child and parent 
characteristics and child and parent gains. The results of 
regression analyses were described in Appendix H and summar* 
ized on pp. 333. 

Interim Report VII presented the results of comparisons 
of two years of Home Start with one year (the Heme Start group 
compared with the delayed-entry group on spring 1975 scores) 
in Chapter IV (pp. 90). In addition, outcomes of the two-year 
Home Start program (pp. 91) and the- relative effectiveness of 
the Home Start treatment for 3-year-olds and 4-year-olds was 
also explored {pp. 91-92). Data from the formative evaluation 
(PP> 99-103) were used to show the impact of Home Start on 
project staff (pp. 97-99) and to show how home visitors' 
expectations for their families and children were affected by 
the program. 

SUPERVISION . Interim Report III (pp. 16-20) identified 
stafr responsible for home visitor supervision and examined 
whether systematic supervision was being provided. Discus* 
sions by dirteOtoiC and supervisory personnel about how often 
supervision should be provided and actual frequency of in- 
home supervision as reported by home visitors were presented. 
Interim Report V ( Program Analysis Volume ^ pp. 36-38) 
reported the amount of time directors and specialists spent 
in the home supervising home visitors. Also discussed were 
other mechanisms for supervising staff. The Cost-Sf f ectiye- 
ness Volume of this report (pp. 33-34) examined the relation- 
ship between the presence of a staff member primarily re- 
sponsible for supervision and the amount of supervision pro- 
vided. The issue of home visitor supervision was examined 
in more detail for " interim Report VII (pp. 64-71) to determine 
whether time spent on home visitor supervision had increased 
in response to National Office guidance. The different super- 
vision mechanisms identified in Interim Report V were described 
extensively in this report. The Homesbook (pp. 5/1-35) also 
addressed issues relating to staff supervision and management. 
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TIME USE . Interim Report V ( Program Analysis Voliime j 
pp* 38" 4 3 ) examiined how home visitors spent their time, as 
well as the relationship between in-home and training ti-ae. 
Shown were the percentages of time that were spent on travel, 
in the home, on family support seirvices, training and other 
activities. Similar data were presented for directors and 
specialists (pp, 30-39)*-- percent of time spent on adminis- 
tration, in the home, family support (helping home visitors 
prepare for visits, referrals and meetings with parents), 
staff supearvision and staff training. The relationship 
between the amount of time spent on administration and faun 
ily support services was examined. The Co st'^Ef fee ti vene s s 
Volume of this report (pp, 90-91) again examined staff time 
use of home visitors, cost implications of variations in 
the number of families served per home visitor, as well as 
trade*-offs between time spent on in**se3nrice training and 
in*-home time with families. 
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